Oleg Taratukhin
|
2e3c4937a3
|
[ai-completion] ML-4099 fix incorrect matching for multi-line comments in Python
GitOrigin-RevId: 5e6a9a56335ede2aac17af34d11e9f616e26d710
|
2024-10-12 17:23:36 +00:00 |
|
Oleg Taratukhin
|
2cfb524931
|
[ai-completion] ML-4059 only compare the first line for relaxed match similarity
GitOrigin-RevId: f489e279b966c32fc4599399f52a67ee64238d1b
|
2024-10-08 15:19:01 +00:00 |
|
Oleg Taratukhin
|
2c3ae4a111
|
[ai-completion] ML-3971 fix typo in LineSimilarityMetric
GitOrigin-RevId: a058fcfd1ece3884eb8609c938fda22eb5d50e7b
|
2024-10-08 15:19:01 +00:00 |
|
Oleg Taratukhin
|
011c763cc5
|
[ai-completion] ML-3971 add metrics with all characters to multi-line reports
GitOrigin-RevId: 25b2c105e31f11f1fdfb9e3e490a95f0aa9a5c05
|
2024-10-08 15:19:01 +00:00 |
|
Oleg Taratukhin
|
5956d51f2f
|
[ai-completion] ML-4058 remove non-optimal default from RelaxedEditDistance
GitOrigin-RevId: dd8cfcbdbbde79357816dffc5bec38c1aaf57254
|
2024-10-08 15:19:01 +00:00 |
|
Nikolai.Palchikov
|
65064a277a
|
[evaluation] LME-94: fix JavaApiCall extractor -- recursion
GitOrigin-RevId: 92b71507ad26d64e0b08eae8edab5103127bb3d1
|
2024-10-08 13:21:23 +00:00 |
|
Alexey Kalina
|
dcd34293b1
|
[evaluation-plugin] LME-136 Add metrics about context size to Evaluation plugin
(cherry picked from commit cd715b0e1820b606c09f4254bf0678961c01a2f9)
IJ-MR-146174
GitOrigin-RevId: 0ba77e26003b8adfe276bd81299aee8f01861384
|
2024-10-08 13:19:59 +00:00 |
|
Vladimir Krivosheev
|
4a176d4c02
|
IJ-CR-146078 extract intellij.platform.bootstrap
GitOrigin-RevId: b79efc92829111228e83058e54381d8e02116b6f
|
2024-10-05 22:01:55 +00:00 |
|
Alexey Kalina
|
f9d3e66ea9
|
[evaluation-plugin] show error dialog if editor is not opened (LME-104)
(cherry picked from commit b9f6ec7f38865a5d136f45bd438456396764abf7)
IJ-MR-145860
GitOrigin-RevId: 8b6545d251dfa4ce2639efdd7561e906b31d8ed5
|
2024-10-04 17:33:25 +00:00 |
|
Alexey Kalina
|
5e2212579a
|
[evaluation-plugin] LME-104 Add IDE action to create dataset entities for Evaluation plugin
(cherry picked from commit 450af2f618f70d7b9e32420f6b41774bd0361321)
IJ-MR-145860
GitOrigin-RevId: 00b460dcdbc47dea38b21d5f89159391efe67b75
|
2024-10-04 17:33:25 +00:00 |
|
Oleg Taratukhin
|
410f7661a6
|
[ai-completion] ML-4039 improve end of multi-line comment detection
GitOrigin-RevId: e8d8da381725b2ba96fea22bdef5eb9466aa956b
|
2024-10-01 23:12:08 +00:00 |
|
Oleg Taratukhin
|
7bbdb90c19
|
[ai-completion] ML-4039 add single-line completion evaluation visitor for sql
GitOrigin-RevId: b78fd1e92c488eb4c0d85ab22e8c43241da84910
|
2024-10-01 23:12:08 +00:00 |
|
Oleg Taratukhin
|
af7483f0d5
|
[ai-completion] make a report link clickable for easier access
GitOrigin-RevId: 6d90f6826991e2a0179188fb5828d2b246b58a82
|
2024-10-01 23:12:08 +00:00 |
|
Oleg Taratukhin
|
28f446816d
|
[ai-completion] ML-3769 use relaxed match as a secondary metric in reports
GitOrigin-RevId: a627b2db311d143beff96c388f0b67505910dbdb
|
2024-09-30 13:31:52 +00:00 |
|
Oleg Taratukhin
|
5df70be0ba
|
[ai-completion] ML-3769 avoid NaNs in metric values for highlighting of a multi-line report
GitOrigin-RevId: 21f49fbc798607a0a1caf123acf197146e672dea
|
2024-09-30 13:31:52 +00:00 |
|
Maxim.Kolmakov
|
6f0c674d64
|
Remove CIServerBuildInfo
It's not used anywhere and requires TC/CI integration
GitOrigin-RevId: 59f27fa3b2a6903d25460e1490b2fb8bf09819b0
|
2024-09-30 10:55:31 +00:00 |
|
Oleg Taratukhin
|
0db65f1144
|
[ai-completion] ML-3971 remove line breaks in relaxed edit distance description
GitOrigin-RevId: f71c8b77cfac476975bc4f7a4b3fca822e7165c7
|
2024-09-29 14:34:35 +00:00 |
|
Oleg Taratukhin
|
7d8bddf1db
|
[ai-completion] ML-3971 update metrics used in report generation for multi-line
GitOrigin-RevId: 97229f91fb401313aa7b63413e3a904ebd1895bb
|
2024-09-28 14:23:59 +00:00 |
|
Oleg Taratukhin
|
02d1a74dff
|
[ai-completion] ML-3971 update metrics used in report generation for multi-line
GitOrigin-RevId: 065307c2f50111610e3468562d0adaddfda189dd
|
2024-09-28 14:23:59 +00:00 |
|
Oleg Taratukhin
|
f2215451e5
|
[ai-completion] ML-3971 add RelaxedExactMatchOnlyAlphanum and RelaxedEditDistanceOnlyAlphanum metrics
GitOrigin-RevId: 18ffbbac437ce330d4006aac7e3d98cf8b43dd42
|
2024-09-28 14:23:59 +00:00 |
|
Oleg Taratukhin
|
ad2a321e64
|
[ai-completion] ML-3971 add RelaxedExactMatch
GitOrigin-RevId: 534a42b955383009d23d6cad909351dc51593d42
|
2024-09-28 14:23:59 +00:00 |
|
Oleg Taratukhin
|
2cbfc156d1
|
[ai-completion] ML-3971 adjust LineSimularityMetric to be able to reuse it for relaxed metrics
GitOrigin-RevId: b1fc67c70a0ca99e16f7ad810d36322b1fe77316
|
2024-09-28 14:23:59 +00:00 |
|
Oleg Taratukhin
|
c162a25e26
|
[ai-completion] ML-3971 rewrite tests to match updated metrics
GitOrigin-RevId: e75b929e608d0618c834f7b7a47a9bb00d291ea9
|
2024-09-28 14:23:59 +00:00 |
|
Oleg Taratukhin
|
3c386270e4
|
[ai-completion] ML-3971 rewrite relaxed metrics as classes and fix issue in RelaxedEditDistance
GitOrigin-RevId: a3386b5381c922aca1e8246826addccf4f6dec2b
|
2024-09-28 14:23:59 +00:00 |
|
Oleg Taratukhin
|
1f0dd83ddd
|
[ai-completion] ML-3971 refactor relaxed metrics to share common code
GitOrigin-RevId: 5fab61381cc5cd990590948cbb4748dad9e68e33
|
2024-09-28 14:23:59 +00:00 |
|
Oleg Taratukhin
|
78d63773ad
|
[ai-completion] ML-3971 implement computeRelaxedEditDistance
GitOrigin-RevId: d79f3ace6267214141d714c2fb027e34846b5fa3
|
2024-09-28 14:23:59 +00:00 |
|
Oleg Taratukhin
|
334749adbb
|
[ai-completion] ML-3971 rewrite relaxed match traversal
GitOrigin-RevId: 610bf50b4544cb7f44c390e354767d7fb0ca5722
|
2024-09-28 14:23:59 +00:00 |
|
Oleg Taratukhin
|
06ee57b078
|
[ai-completion] ML-3971 add tests for relaxed EM
GitOrigin-RevId: ba3e62fee6501f8fb9a7cca37e779d871f4d6475
|
2024-09-28 14:23:59 +00:00 |
|
Oleg Taratukhin
|
b47c41525a
|
[ai-completion] ML-3971 add utility for relaxed exact match calculation
GitOrigin-RevId: 9e7e26eb261d79e5029bf24d5ab7c36535bccaa1
|
2024-09-28 14:23:59 +00:00 |
|
Oleg Taratukhin
|
5eba1ea80b
|
[ai-completion] ML-3971 add a test case for preProcessLines
GitOrigin-RevId: 5a050504c56542aabdafe5d3b4a8fc11ce3d1150
|
2024-09-28 14:23:59 +00:00 |
|
Oleg Taratukhin
|
d61150f7b8
|
[ai-completion] ML-3971 simplify preProcessLines
GitOrigin-RevId: b5150a517cfb4e5aca52c20de7a6f1866f976880
|
2024-09-28 14:23:59 +00:00 |
|
Oleg Taratukhin
|
7c5448ace4
|
[ai-completion] ML-3971 write line-preprocessing for metrics
GitOrigin-RevId: d86916ad8253950c2d92fe34de9ef0b0e147e50f
|
2024-09-28 14:23:59 +00:00 |
|
anton.spilnyy
|
c1c0d49b2c
|
[aia-eval] remote static dataset. better error handling
GitOrigin-RevId: 60a9cd6f56c7db8ac268d8c32fb55aed9e26c5f0
|
2024-09-27 14:55:34 +00:00 |
|
Nikolai.Palchikov
|
4972249373
|
[evaluation] remove empty file
GitOrigin-RevId: 98034e5c418bfbb9b00a8b90cec6000006ad6ad3
|
2024-09-27 12:56:30 +00:00 |
|
Nikolai.Palchikov
|
1c7c1a7c82
|
[evaluation] LME-94, LME-112: rename classes for consistency
GitOrigin-RevId: be5b206c5a92b9180df9c0952e03c65423c333ac
|
2024-09-27 12:56:30 +00:00 |
|
Nikolai.Palchikov
|
55f218774b
|
[evaluation] LME-94, LME-112: integration test for action processor for chat-code-generation
GitOrigin-RevId: ef15c984c00fd897f5a962c96c62517bb0e9bb93
|
2024-09-27 12:56:30 +00:00 |
|
Nikolai.Palchikov
|
6552571342
|
[evaluation] LME-94, LME-112: more tests for method call extraction + little optimize
GitOrigin-RevId: 3757d83dea8a055e0e79ae16319d111837685a9c
|
2024-09-27 12:56:30 +00:00 |
|
Nikolai.Palchikov
|
58d56ac7d1
|
[evaluation] LME-94, LME-112: tweak metaPrompt, extract api calls only from generated method with right name
GitOrigin-RevId: e35588bd2b42b20a680dfca0bdd0681e7168e873
|
2024-09-27 12:56:30 +00:00 |
|
Nikolai.Palchikov
|
e7cb66cd1a
|
[evaluation] LME-94, LME-112: refactor api call extraction, filtering out super callsa, constructor calls and calls inside constructor
GitOrigin-RevId: bc8706308ae33c4b86b1547ff1435eee9db5382f
|
2024-09-27 12:56:30 +00:00 |
|
Nikolai.Palchikov
|
cfbdd4667c
|
[evaluation] LME-94, LME-112: refactor: use QualifiedNameProviderUtil directly
GitOrigin-RevId: d8c95d8a715d946dd3d827f4aa3e1704d940a14d
|
2024-09-27 12:56:30 +00:00 |
|
Nikolai.Palchikov
|
5c33ba9739
|
[evaluation] LME-94, LME-112: refactor: use internal language structure instead of platform one, pass it to the feature invoker
GitOrigin-RevId: 0ab00dfe825b0a442e1b71dc54eacd6c3ac7f8bb
|
2024-09-27 12:56:30 +00:00 |
|
Nikolai.Palchikov
|
5b0e72c848
|
[evaluation] LME-94, LME-112: initial implementation of API Recall for generation-in-chat evaluation
GitOrigin-RevId: 748bbac2646f9671c86a752bda7f915f411d2530
|
2024-09-27 12:56:30 +00:00 |
|
Alexey Kalina
|
9bf856ea29
|
[evaluation-plugin] revert changes in SetupJDKStep (LME-102)
(cherry picked from commit d3a7ec65330ee3ba249d1b4a975409e7418523d2)
IJ-MR-145189
GitOrigin-RevId: 0aaa43446318ec9aab2e33e3a151b955c52688cd
|
2024-09-27 10:54:36 +00:00 |
|
Alexey Kalina
|
c22b191956
|
[evaluation-plugin] reuse visualization from code generation in test generation evaluation (LME-102)
(cherry picked from commit c374b492a84cdc7d3fdef3dcca16bfc7865efc1d)
IJ-MR-145189
GitOrigin-RevId: 3d4f4ea6ca9243cafdd8a7aaa1cff0f8683bc346
|
2024-09-27 10:54:36 +00:00 |
|
Alexey Kalina
|
858677e87a
|
[evaluation-plugin] skip test files in test generation evaluation (LME-102)
(cherry picked from commit db82f818d684865e5dedd5971b2ea9d8c5b65afc)
IJ-MR-145189
GitOrigin-RevId: efa57f6d707e7f17e1ce1653841b71d02cfc4ece
|
2024-09-27 10:54:36 +00:00 |
|
Alexey Kalina
|
dae1a63ef4
|
[evaluation-plugin] Add tests on tests generation evaluation (LME-102)
(cherry picked from commit 9b0fa587dedf3fb43b554bab88b78dd007839cfa)
IJ-MR-145189
GitOrigin-RevId: 4e385f662a1bed42c19d9953c485b698dfa8a018
|
2024-09-27 10:54:36 +00:00 |
|
Alexey Kalina
|
c209d8d272
|
[evaluation-plugin] LME-102 Support test generation in Evaluation plugin
(cherry picked from commit c3df20632134448a7497cb21191c588c9c9df9a4)
IJ-MR-145189
GitOrigin-RevId: 60c57966739f66fdf2f60147ce9223333a8fa76c
|
2024-09-27 10:54:36 +00:00 |
|
anton.spilnyy
|
3604b853b7
|
[aia] test gen - simplify strategy
(cherry picked from commit 4ee5decbcb0c98de1b56731dd288bb0a889a2bf0)
IJ-MR-145189
GitOrigin-RevId: e53ab5f413256a7ee921518d32b957fd92866171
|
2024-09-27 10:54:36 +00:00 |
|
anton.spilnyy
|
869f3d8b7c
|
[aia-eval] fix resolving datasetRef from config
GitOrigin-RevId: 6f45a9c731125fb6a9fdf00feb888eb97136c7ad
|
2024-09-26 17:39:26 +00:00 |
|
Alexey Kalina
|
11d3393fff
|
[evaluation-plugin] LME-114 Write the number of sessions left in the last file to console during end-to-end evaluation
GitOrigin-RevId: aa8ef5d9184373e83b77cdb83ba2cabc2ce3d23e
|
2024-09-24 10:44:06 +00:00 |
|