Nikolai Bogdanov
db0d10e846
[aia] LME-609 Remove PSI magic from maven execution
...
Merge-request: IJ-MR-178680
Merged-by: Nikolai Bogdanov <nikolai.bogdanov@jetbrains.com >
(cherry picked from commit 33e6ab060c2be0bd2213dbc3ea07a54b0cf8baf9)
IJ-MR-178680
GitOrigin-RevId: 53cbe56202d3586cda0d26260dc9c653422820f4
2025-10-20 19:00:17 +00:00
Roman Vasiliev
4c93e1c18a
[evaluation-plugin] LLM-19945 Make exception more meaningful
...
GitOrigin-RevId: bdea0f3507d4e75a1d7a54a34ae099967aed0e38
2025-10-09 15:43:52 +00:00
Ilia Kirianovskii
f43aa95086
[bazel] Update build files (IJI-3062)
...
GitOrigin-RevId: 98a67396a48bddc3d084cc93c50ae2f2017bfe8c
2025-09-29 00:11:15 +00:00
Ilia Kirianovskii
6f8920da99
[bazel] Update build files (IJI-3062)
...
GitOrigin-RevId: 2394c1289e33945f7640f249b17cbf34b31fd695
2025-09-23 09:25:59 +00:00
Nikolai Bogdanov
3ae86b2093
[llm-eval] LME-573 Proper gradle build for eval
...
[llm] LME-575 Remove git usages
[llm] LME-573 Fix gradle execution for aia eval
Merge-request: IJ-MR-175542
Merged-by: Nikolai Bogdanov <nikolai.bogdanov@jetbrains.com >
GitOrigin-RevId: b236549d6d1afc086db8b393d05bd5d648455b23
2025-09-15 09:05:57 +00:00
Nikolai Bogdanov
0cb6973060
[llm] LME-573 Some adjustments for docker eval
...
[llm] LME-573 Mount bin folder to have the HTML report back from docker
[llm] LME-573 If tests are failed - score shouldn't be 1.
[llm] LME-573 If no tests are passed, all tests should be triggered
Merge-request: IJ-MR-175152
Merged-by: Nikolai Bogdanov <nikolai.bogdanov@jetbrains.com >
GitOrigin-RevId: f71a97835e0837477b110e1699662063ff0fa8a4
2025-09-10 15:10:52 +00:00
Ilia Kirianovskii
dc268560b6
[bazel] Update build files (IJI-2835)
...
GitOrigin-RevId: 275260ab73f59d3c08f0b4cb9f4c89b74054094a
2025-08-20 08:49:22 +00:00
Roman Vasiliev
09395ad271
[evaluation-plugin] LME-555 Skip pom xml explicitly and put -am to the right place
...
GitOrigin-RevId: 1a2aa4b9eb2f1852869b85b07bcb674d3158cc17
2025-08-19 08:50:07 +00:00
sebastian.chiriac
70e3b69c74
[Eval Plugin] LLM-18237: added element_type inside Lookup additionalInfo
...
GitOrigin-RevId: e5c5cf55629243c6dcc12b98d33a99fa6f414901
2025-07-25 11:16:34 +00:00
Leonid Shalupov
cff76ea65e
bazel: split test and build sections in convert jps to bazel:L update Bazel files
...
GitOrigin-RevId: 90063178de33c2a95bfdebd160a721d6977d8097
2025-07-18 16:18:47 +00:00
Roman Vasiliev
ae788a52a7
[evaluation-plugin] LME-492 Make it possible to run instances from SWE-polybench
...
GitOrigin-RevId: 959545586a600d8cedef959ab27caac7f585fdb8
2025-07-18 15:06:51 +00:00
Roman Vasiliev
c53bb74389
[evaluation-plugin] Drop the existing project sdk in cases when it could be attached mistakenly
...
GitOrigin-RevId: 42bd8677d1461bde1b2c8484ebf252717a07caed
2025-07-18 15:06:51 +00:00
anton.spilnyy
12df2e1c66
[aia-eval] cg swe. adjust tests extractor
...
GitOrigin-RevId: 28684bdc9df19ff46620b5e18185a5291d6449f8
2025-07-15 14:39:44 +00:00
Roman Vasiliev
66f67ad877
[evaluation-plugin] LME-463 Implement Gradle test runner
...
GitOrigin-RevId: 167190c4a967626abb5704932bd84a5c1b040930
2025-07-08 20:43:03 +00:00
Evgenii Ilichev
06fb3e21e6
Update test definitions in BUILD.bazel
...
GitOrigin-RevId: 12636c0153e8909f9d9658a07278edac5ceb9c23
2025-06-18 19:05:49 +00:00
Vladimir Krivosheev
a49e310575
IJ-MR-162467 don't export intellij.platform.lang.core
...
GitOrigin-RevId: dea0fc36382a29eda134dba69917d41c7b585cf2
2025-06-18 11:28:23 +00:00
Anton Spilnyy
0fb305eeb5
[aia-eval] junie swe bench for edit mode. add "Project Is Resolvable" metric
...
GitOrigin-RevId: bb322fee31eb1657422c2e28f7f721c75b66b5af
2025-06-18 10:57:16 +00:00
Nikolai Bogdanov
7012107f2f
[llm] [eval] Support for generated SWE dataset
...
GitOrigin-RevId: 2631c01b2e70c935d9248a95e217a7c8c1d64b71
2025-06-17 18:49:22 +00:00
Dmitry.Yudin
654d93e8d3
IJPL-192027 Add Maven repository path utility to buildScripts.downloader, replace hardcoded Maven repository path usages
...
Introduced `MavenRepositoryPathUtil` for resolving Maven repository paths.
Replaced direct `.m2/repository` references with `getMavenRepositoryPath()` utility.
Merge-request: IJ-MR-164088
Merged-by: Dmitry Yudin <Dmitry.Yudin@jetbrains.com >
GitOrigin-RevId: 7bef169608fd1674f457c7fffd2edf4122b82a1c
2025-06-17 12:50:09 +00:00
Vladimir Krivosheev
c16c64e766
IJ-MR-162467 don't export intellij.platform.jps.model.serialization
...
GitOrigin-RevId: 4c70b0e49def83b78d1daf23c50bed6b7f41cb57
2025-06-16 14:54:15 +00:00
Vladimir Krivosheev
b935234c91
IJ-MR-162467 don't export intellij.platform.projectModel
...
GitOrigin-RevId: 11c0bf5ca0f3a6d892658a2b149d85cace9aa2b8
2025-06-14 13:00:48 +00:00
Vladimir Krivosheev
ef0323d07c
IJ-MR-162467 don't export intellij.platform.core
...
GitOrigin-RevId: 05f350c1c087be1bf9b46d8bdac5345a65f55958
2025-06-13 21:52:48 +00:00
Roman Vasiliev
858102e394
[evaluation-plugin] Remove possible IDEA format add-on from test reference
...
GitOrigin-RevId: 0343efc32197cc02394faaa512bdc141b64af3d5
2025-06-13 13:09:55 +00:00
Roman Vasiliev
05e8225bec
[evaluation-plugin] LME-468 Add metric to check how many tests failed to start
...
GitOrigin-RevId: 56ce1442bdd52889e09fa78235db8c7e85c4b3b7
2025-06-12 17:08:37 +00:00
anton.spilnyy
efebd2c2f8
[aia-eval] junie swe bench for edit mode. improve maven test result parser
...
GitOrigin-RevId: fb0b66fd2c045d820f907a49d597be4c6ad58c20
2025-06-12 13:14:52 +00:00
Nikolai.Palchikov
f157d3df9d
[aia] LLM-17290 replace relative path in tests
...
GitOrigin-RevId: 455aeb65f7daf24b798731978da03493749c6e77
2025-06-11 19:14:38 +00:00
Nikolai.Palchikov
4966380483
[aia] LLM-17290 update bazel
...
GitOrigin-RevId: 940dc2f5f92621ced2df0a2ae79815ff5408b3ed
2025-06-11 19:14:38 +00:00
Nikolai.Palchikov
fa6e1371e5
[aia] LLM-17290 Refactor extractAdditionalProperties -- move to core, remove unnecessary dependency
...
GitOrigin-RevId: df4f71b8f96354fed1bda1707232b248696c7e9a
2025-06-11 19:14:38 +00:00
Nikolai.Palchikov
20e5b0331c
[aia] LLM-17290 add the method for external api call extraction in ApiCallExtractor; test for java added
...
GitOrigin-RevId: 522b4d7410555c69e691a272108c754a3d3efa4a
2025-06-11 19:14:38 +00:00
Nikolai.Palchikov
e2cc44b1ca
[aia] LLM-17290 add external api recall calculation, adapt chat code generation feature to a new report type
...
GitOrigin-RevId: 96f0f2fa5994a24b61d30a0824f447e35417d121
2025-06-11 19:14:37 +00:00
Nikolai.Palchikov
e8e0390d34
[aia] LLM-17290 Add external API method extraction to JavaChatCodeGenerationVisitor
...
GitOrigin-RevId: 0ab11fa8fe91530f85a6a0399a6fb5a8ce9ba23d
2025-06-11 19:14:37 +00:00
Nikolai.Palchikov
37184710ea
[aia] LLM-17290 cleanup: remove duplication
...
GitOrigin-RevId: 9c504880d341b37f3ddb5ce28a27e8cac9a38d94
2025-06-11 19:14:37 +00:00
Nikolai.Palchikov
34a3d831f7
[aia] LLM-17290 create test for JavaChatCodeGenerationVisitor
...
GitOrigin-RevId: a96e799ea0e9ed9c2e3ce9d537fb3c141dbf8ec1
2025-06-11 19:14:37 +00:00
Vladimir Krivosheev
65fe061584
IJ-MR-162467 don't export intellij.platform.analysis
...
GitOrigin-RevId: fcbcb68010b58cb507fee2c47473758b999e471b
2025-06-04 11:16:33 +00:00
anton.spilnyy
b4b1616355
[aia-eval] sandbox
...
GitOrigin-RevId: 069baa68be6d49ec7d0c32c8178db4c9cd374264
2025-06-03 16:18:16 +00:00
Roman Vasiliev
579c97ccb9
[evaluation-plugin] Allow run maven tests for kotlin
...
GitOrigin-RevId: 3b57f9ee775f7113eedf70df27d6a53ec03f703f
2025-05-29 12:57:38 +00:00
anton.spilnyy
5f2216a336
[aia-eval] junie swe bench for edit mode. run only required tests + more data in report
...
GitOrigin-RevId: 70c9bc84dcdff4c37fb4ea746d173a5456137826
2025-05-23 06:47:26 +00:00
anton.spilnyy
25c6cb7ac8
[aia-eval] junie swe bench for edit mode. fix modules structure
...
GitOrigin-RevId: 3705a193695a485965a2dff98605fda31a5d24a7
2025-05-21 19:54:13 +00:00
Vladimir Krivosheev
fbc9805e89
IJ-MR-162467 don't export intellij.platform.jps.model
...
GitOrigin-RevId: ebaebc90d514e5f3046fe2b973647da4bf156625
2025-05-14 18:10:23 +00:00
Vladimir Krivosheev
53ab1b258e
IJ-MR-162467 do not export intellij.platform.refactoring
...
GitOrigin-RevId: 4bb68401d046d1fffba4fa73935bb1c404d8d49f
2025-05-09 20:49:36 +00:00
Vladimir Krivosheev
7cf9ef2b29
update bazel files
...
GitOrigin-RevId: e78f86bd17affd7892fd1af8e157f033906b1865
2025-05-09 15:36:06 +00:00
Vladimir Krivosheev
644a6b2e81
IJ-MR-162467 don't export intellij.platform.editor.ui
...
GitOrigin-RevId: 8894abe16fb347de7649bfb2d7888b6e6fe0232c
2025-05-09 14:20:40 +00:00
Vladimir Krivosheev
6f8ff07ccc
simplify bazel labels (another step towards using simple names that reflect directory structure)
...
GitOrigin-RevId: 12bfb2d0fa315d87c7a4ade363d0f834cf324b71
2025-05-08 16:58:30 +00:00
Nikolai.Palchikov
131533938d
[aia] LLM-16421 remove optimise_imports.py
...
GitOrigin-RevId: 2216645b89c3692f066650335a242480b7c5e383
2025-04-25 15:31:23 +00:00
Nikolai.Palchikov
31c079e4e0
[aia] LLM-16420 add python script for proper adding of optimise step to old actions (for proper comparison)
...
GitOrigin-RevId: 8d82493b1db0be8c4f8671f20d1b21f7e2e979ec
2025-04-25 15:31:23 +00:00
Nikolai.Palchikov
04af2ede82
[aia] LLM-16420 extract imports from all snippets and not only one generated
...
GitOrigin-RevId: 4acca0af6497fd5c2245bc9d50b2c543be8782c4
2025-04-25 15:31:23 +00:00
Nikolai.Palchikov
ecf7ac369b
[aia] LLM-16420 add the ability to paste imports of the generated code to existing file
...
GitOrigin-RevId: f174ad641688ea8181f0e67ccb0190fbb1291b87
2025-04-25 15:31:23 +00:00
sebastian.chiriac
6a11d7e0f6
LLM-13849: added text completion visitors and run configurations for Kotlin and Python
...
GitOrigin-RevId: 787713016e10af307e0523f2a0da6d1197dee89f
2025-04-04 11:42:51 +00:00
sebastian.chiriac
2fdf97378b
LLM-13849: added custom logic for selecting positions in text completion evaluation
...
GitOrigin-RevId: 6696c86ec045675b182b0c07b56b65e272d23c35
2025-04-04 11:42:51 +00:00
Sebastian.Chiriac
a3e95b47ea
LLM-13849: refactored Kotlin and Java LineCompletionEvaluationVisitor to have less dependencies
...
GitOrigin-RevId: 44a0904d4911ccec8343d5d8875fe82edd3e7562
2025-04-04 11:42:51 +00:00