Commit Graph

75 Commits

Author SHA1 Message Date
Alexey Kalina
5616563771 [evaluation-plugin] LME-99 Don't close popup in the report by clicking on it
GitOrigin-RevId: 47dc9d1581f54e4b133fe99a551c21855465a290
2024-09-13 17:05:22 +00:00
Oleg Taratukhin
ff13802ec2 [ai-completion] ML-3861 fix context schema in evaluation reports
GitOrigin-RevId: 60a019acb3e750fbeefa0fcda08befe882497746
2024-08-15 19:49:28 +00:00
Oleg Taratukhin
88cf6987b5 [ai-completion] ML-3844 handle empty context json in supplementary script in eval plugin
GitOrigin-RevId: 584e9d282587b03e2af1ee6272a422c21664a1e9
2024-08-14 17:47:14 +00:00
Roman Vasiliev
6885449ebb [evaluation-plugin] LME-40 Implement evaluation for missing function calls using tests as references
- implemented function calls: find_text, find_usages, get_code_at_caret, get_opened_files, get_selected_current_file and read_file
- expand JavaFunctionCallingActionsProcessorTest for all token types


Merge-request: IJ-MR-142324
Merged-by: Roman Vasiliev <Roman.Vasiliev@jetbrains.com>

GitOrigin-RevId: 924376a7a46922058d4242fbf05469cab9f2fb0d
2024-08-13 10:34:43 +00:00
Alexey Kalina
03e0162d4c [evaluation-plugin] don't show additional tab with contexts if they don't exist
GitOrigin-RevId: 48d41e1db0f3b51ea4ec0f005429244f4946773c
2024-08-12 12:08:30 +00:00
Alexey Kalina
43d1d05799 [evaluation-plugin] LME-21 Provide additional diagnostics in function calling reports
(cherry picked from commit cf17dfda2911d6f89553b2d6247fbe99bea10efe)

IJ-MR-141531

GitOrigin-RevId: f04882ea3212cb9c31e83c5e1baec9a46ffdc929
2024-08-01 13:22:40 +00:00
Berkay Özerbay
66e5fb9af9 undo: Add context handling to evaluation popup logic
This update introduces the `addContexts` function, which adds context handling to the evaluation popup logic. Contexts are now appended when the session contains specific classes, enhancing the popup with additional context information. The code adjustments ensure that class management is consistent when determining whether to add features, contexts, or suggestions.

GitOrigin-RevId: 4318850b2be63f091f59a595957bde5f54c7259f
2024-07-31 15:21:15 +00:00
Berkay Özerbay
d289e766f2 Remove unnecessary "contexts" step from feature order comment.
GitOrigin-RevId: bca64c2190576622f2d55897a07d7db24100f1c0
2024-07-31 15:21:15 +00:00
Berkay Özerbay
0a5dcfa867 Remove empty tab for addContexts
Eliminated `addContexts` function and related code as it was unused. Simplified logic in `addCommonFeatures` and `addSuggestions` by removing references to non-existent contexts.

GitOrigin-RevId: c1d5e1f4dfd067019a5a6fa249f6fac42320b3d9
2024-07-31 15:21:15 +00:00
Alexey Kalina
4ffe4dca5f [evaluation-plugin] LME-10 Smart Chat. Support function calling in Evaluation plugin
GitOrigin-RevId: 7dbb95a7be9a831b87feec3e27658769fa5a11e7
2024-07-22 11:49:40 +00:00
Oleg Taratukhin
8a841d4f84 [ai-completion] ML-3574 remove common leading indents from multi-line suggestions
GitOrigin-RevId: 4c1d8723485b5f5f64dcaac904efab61fe871c56
2024-06-29 00:16:09 +00:00
Oleg Taratukhin
0c280a3e37 [ai-completion] ML-3574 add diagnostic information to reports
GitOrigin-RevId: 393504bb18a68168b46fa9c999a0bd6e5b98dce9
2024-06-29 00:16:09 +00:00
Oleg Taratukhin
0ac766902a [ai-completion] ML-3537 remove lineDiff to get completion reports working
GitOrigin-RevId: 07793222d378739db7a2ba86556046d6ec9f3bb9
2024-06-26 19:39:41 +00:00
Berkay Özerbay
10c7135026 delete console logs
GitOrigin-RevId: b53f2df0e5d5251a1981b00e612cee5b8fdaeee6
2024-06-20 12:51:08 +00:00
Berkay Özerbay
e84db2d94d detecting code-generation in html through script.js
GitOrigin-RevId: ae95b03846e71ca5e20e9c3a871da9cfb6828cee
2024-06-20 12:51:08 +00:00
Berkay Özerbay
0969bb413a Add code generation prompts and extend popup update logic
Several updates were made to the script.js file: Code generation prompts (e.g., "cover this method with logging", "simplify the following method") were added and the updatePopup function was modified to handle these prompts. This includes extending the conditions for adding features and contexts, as well as adding a check for whether a prompt is among the defined code generation prompts before deciding between adding a diff view or suggestions.

GitOrigin-RevId: 9d98eb5035aeaff87753a38e1c581850c9021c1e
2024-06-20 12:51:08 +00:00
Berkay Özerbay
22c95bd6da fix:Refactor diff.js in evaluation-plugin
GitOrigin-RevId: 9454dc73b294062f99cba51e866543a266bc1206
2024-06-20 12:51:08 +00:00
Berkay Özerbay
8d44e39bc0 Refactor code for line difference calculations
The line difference calculation code was refactored and moved from 'script.js' to 'diff.js' to improve code organization. This change improves maintainability and clarifies the source of these functions. Furthermore, it allows a more modular structure, with related functions grouped together. The function call in 'script.js' has been updated to reflect this change.

GitOrigin-RevId: a24c07b86588106acae1946f605e48c7472fca44
2024-06-20 12:51:08 +00:00
Berkay Özerbay
8e1df7c5b9 revert extra space
GitOrigin-RevId: 7f6c510cebd33fbc9d017b4deb09fee85b7ad974
2024-06-20 12:51:08 +00:00
Berkay Özerbay
5c39075166 revert unnecessary changes in style.css
GitOrigin-RevId: 85bce2f3fdbff6cb8e4482cbc351e95f667365af
2024-06-20 12:51:08 +00:00
Berkay Özerbay
768a928e18 revert first two lines
GitOrigin-RevId: 14f70e315a241cde7f47babe918e93614589945d
2024-06-20 12:51:08 +00:00
Berkay Özerbay
de40059240 revert extra space
GitOrigin-RevId: e86ba3844ad3cc361567f9298f63a0cbd6c92854
2024-06-20 12:51:08 +00:00
Berkay Özerbay
09bf2427ce Refactor script.js to remove "suggestions" references
The update removes all instances of "suggestions" from the sessionDiv class list methods in script.js. The code has been streamlined for better maintainability, where redundant references to "suggestions" were removed as part of an overall effort to improve code readability and performance.

GitOrigin-RevId: 43fbc3d6acd06fe14828fc8f95ca47c42d2f75a7
2024-06-20 12:51:08 +00:00
Berkay Özerbay
5f09dd82e7 delete export default Diff
GitOrigin-RevId: b0cc10dc3fc94f2938f7b44cc2789ee42ecff9d5
2024-06-20 12:51:08 +00:00
Berkay Özerbay
11642a147a Add new resources to report generators
Two new script resources, diff.js and script.js, have been added to the report generators in FileReportGenerator.kt and HtmlReportGenerator.kt. They are expected to enhance the reporting capabilities towards the plugin's evaluation process. An unnecessary import statement from script.js has also been removed.

GitOrigin-RevId: eb2953c95e0f0c2a070ca4988575309dfa4a2354
2024-06-20 12:51:08 +00:00
Berkay Özerbay
e809a102a7 Refactor script.js and remove duplicate java-code-generation.json
Removed unnecessary java-code-generation.json, as it seems to be a duplicate file. Refactored script.js, by moving the Diff class to a new separate file diff.js, for better code organization and readability. This change will make the code easier to maintain.

GitOrigin-RevId: 5a4fd4d0cbc97a75731ba71fef26af28a5ec7480
2024-06-20 12:51:08 +00:00
Berkay Özerbay
a61f98c622 Remove unnecessary console.log statements
GitOrigin-RevId: f7718d8785f94de1b53565471a1ccdfe906e88b2
2024-06-20 12:51:08 +00:00
Berkay Özerbay
4d0c604af6 Improve code diff view and context handling
The commit adds console logging in the diff function to display changes. It also corrects the handling of CSS classes between different context views for sessionDiv in the evaluation plugin. Specifically, the "diffView" class is correctly added and removed when switching between different contexts. This ensures proper styling and functionality across different components.

GitOrigin-RevId: 6c5cc92c05ab67300d7c8184733d3d1946c00b2b
2024-06-20 12:51:08 +00:00
Berkay Özerbay
c5d619186f Ensure indentation in evaluation-plugin
The change in the script.js file of the evaluation-plugin sets the style of lineDiv to 'pre'. This modification will help in preserving the indentation in the generated output by maintaining white spaces as they are without collapsing them.

GitOrigin-RevId: 3a0dd4acfda92aa36f58be3dfd749076c0aa5a19
2024-06-20 12:51:08 +00:00
Berkay Özerbay
b1e8f991dd Improve visualization of code differences in evaluation plugin
This update enhances the readability of code differences visualized by the evaluation plugin. Added and removed lines are now clearly tagged with their respective old and new line numbers. This addition offers a more straightforward way to see which lines have been changed or removed from the previous version.

GitOrigin-RevId: 310a7070ec40f76135dccd8c7453a776b7c4c2ae
2024-06-20 12:51:08 +00:00
Berkay Özerbay
5f126753c6 A style property is added to ensure indentation is preserved during debugging.
GitOrigin-RevId: 4acb277f205b3864f6056a07e5dfe4936968091a
2024-06-20 12:51:07 +00:00
Berkay Özerbay
2d2e45bb65 Refactor evaluation-plugin core script
The revision involves an overall code cleanup and improves the script's readability and efficiency. Changes include converting a function constructor to a modern JavaScript class and refactoring the `addDiffView` function to utilize the new `unifiedSlideDiff` function that was created to generate a unified diff view. Unnecessary console logs were also removed for better performance.

GitOrigin-RevId: 870c7c1297474c7c6df5c2e25782a3e93f995f07
2024-06-20 12:51:07 +00:00
Berkay Özerbay
81084f2765 draft: Enhance evaluation plugin with DiffView and commit message generation
Added DiffView to the evaluation plugin core and created a new file for Java code generation configuration.
DiffView presents the differences between the old and new code which aids in code evaluations. Also, included Java code configuration which allows to customize code evaluation features such as filters, user prompts and actions.

GitOrigin-RevId: a11d276f746b3a1a0d0149b08938b217d0c4b0a4
2024-06-20 12:51:07 +00:00
Oleg Taratukhin
e8c612b052 [ai-completion] ML-3423 fix the property name
We used a non-existent property when building a window with context, it was displayed as `undefined`. This commit fixes it.

GitOrigin-RevId: 2100f4c0fcb9d3c03fd0986967d0b462976fa7c3
2024-06-07 08:34:36 +00:00
Oleg Taratukhin
398efe2891 [ai-completion] ML-3308 reuse the same context for copying and displaying
GitOrigin-RevId: 27de929c8dc5d1c5e9d137652debab88b4acd992
2024-05-17 05:43:59 +00:00
Oleg Taratukhin
9592d397c4 [ai-completion] ML-3308 add a button to copy request context to clipboard in evaluation plugin
GitOrigin-RevId: 7d02e0e6970bdbd51224da4c4830f1a9a93f04e9
2024-05-17 05:43:59 +00:00
Oleg Taratukhin
ae4532fa76 [ai-completion] ML-3216 present context on a separate popup
GitOrigin-RevId: d721dc334128256eb55b24bc27fb120ecedbb0e6
2024-05-08 12:08:33 +00:00
Alexey Kalina
836eaaa85f [evaluation-plugin] rename completion css class to session
GitOrigin-RevId: 91b522656d7f0e5d7be3b89a5de3412c5e881c5c
2024-05-07 08:55:09 +00:00
Alexey Kalina
d6c1c1ee32 [evaluation-plugin] LLM-2804 Add support for Code Generation feature in Evaluation plugin
GitOrigin-RevId: 21e1b8cce4e55c0828c27268840fbe3dc5be172b
2024-05-07 08:55:09 +00:00
Alexey Kalina
69fd98f48d [evaluation-plugin] add context to ai assistant reports
GitOrigin-RevId: 4cba896c972a0736254d9e4d131a4092a0720c79
2024-04-17 19:17:25 +00:00
Alexey Kalina
7a0e58cbef [evaluation-plugin] ML-2775 Incorrect eval report rendering
GitOrigin-RevId: d165f78f3c0fee13a02d812d1fa2ee2589a1409d
2024-03-19 15:52:36 +00:00
Darya.Rovdo
5879830b46 [evaluation-plugin] ML-2576 Fix MR comments
GitOrigin-RevId: 1c36b8afd08a6cf67a8e38cf2f0666da9ab67f6f
2024-03-05 20:23:20 +00:00
Darya.Rovdo
90e10c967a [evaluation-plugin] ML-2576 Add filter model to eval plugin, propagate into statistics
GitOrigin-RevId: 21eefd216fea407ab442d3b0f107142537b18553
2024-03-05 20:23:20 +00:00
Petr Surkov
ac16eeda3a [full-line] ML-2785 use table in double click eval
GitOrigin-RevId: 641dc763de1b9b827675e78ead77abe4adc45a52
2024-02-21 16:31:20 +00:00
Alexey Kalina
777beea443 [evaluation-plugin] ML-2689 Higlight wrong raw and analyzed filters in evaluation separately
GitOrigin-RevId: b2a7ecf75d38b94e0a6143904d42f82802875b6e
2024-02-08 19:32:04 +00:00
Sergey Stoyanovsky
fc45df823c [eval-plugin] Add metrics column to multiline completion evaluation reports
GitOrigin-RevId: f8b89351356263fb4ed3df7c866efdbbffbe5b0b
2024-02-08 17:32:12 +00:00
Alexey Kalina
9569373e4a [full-line] ML-2610 Highlight wrong filtering in evaluation reports
GitOrigin-RevId: 1a18b3a74d3a318d6b3a8a2f8c14782a38d5a9c1
2024-02-07 18:59:35 +00:00
Petr Surkov
29582cf064 [full-line] ML-2572 Add result proposals to FL diagnostics and eval double-click
GitOrigin-RevId: b5650cdbf6224df9c4c31905fc66ea417dd7dd47
2024-02-01 15:51:40 +00:00
Petr Surkov
3df08c62d1 [evaluation-plugin] Add analyzed proposals to eval reports
GitOrigin-RevId: b419061842dedad3df1619514338378e6380ef82
2024-01-22 14:26:40 +00:00
danila.savenkov
c0aee0412b [full-line] fix escaping in rendering full-line report
GitOrigin-RevId: 52e3d96377a1045026e83d27007d396ec88cbce5
2024-01-05 23:01:49 +00:00