Commit Graph

75 Commits

Author SHA1 Message Date
Iurii Akatov
c06a2a961f ML4SE-698 Implement features in plugin
- Added new plugin to collect initial data for future Federated Compute model
- Based on https://jetbrains.team/p/ij/reviews/133737/timeline

Merge-request: IJ-MR-135570
Merged-by: Iurii Akatov <Iurii.Akatov@jetbrains.com>

GitOrigin-RevId: b2bff07b4abcf82198564707809cb56379d0084f
2024-06-07 20:21:29 +00:00
Daniil.Bubnov
64e121a5dc AP-6609 Map ids between FUS and ML
use machine id salt

GitOrigin-RevId: e6a5a4b80896ef9908258795e0f383dda883e4b8
2024-06-03 12:02:34 +00:00
Samuel Soukup
45e6712ed8 [ML in SE]: IJPL-155930 - add features for case-insensitive exact matching.
GitOrigin-RevId: 533b5120eeced432b9ed9b5bd1aabb9c63b25a16
2024-06-03 09:06:34 +00:00
Daniil Ovchinnikov
6226776bd0 IJPL-148997 exclude non-abstract toString() from the API dump
GitOrigin-RevId: 6352bbb374532bca296d08131ae50083f69e46c0
2024-05-29 00:05:31 +00:00
Gleb.Marin
c06f2b2e49 JBAI-3901 ML API: Remove dependency on FUS & IJ Platform
Add a comment about the copy-pasted event fields

Conceal exposed API

Implement missing string field converter

JBAI-3901 Remove dependency on FUS

Conceal platform API

Fix references in the documentation

Replace IJ's FUS with a custom one


Merge-request: IJ-MR-133194
Merged-by: Gleb Marin <Gleb.Marin@jetbrains.com>

GitOrigin-RevId: b783a8e8ba7e77c5126b028c39cae7ccb0615024
2024-05-07 15:30:00 +00:00
Daniil Ovchinnikov
b03b92e140 IJPL-148490 clean up empty file-classes from existing dumps
GitOrigin-RevId: ca701387e601a76ae25a3a31ca0a02432126e0fb
2024-04-30 20:39:42 +00:00
Gleb.Marin
2a09b06a37 [full-line] Log sessions only rarely
Make small ML API fixes & documentation

Fix rebase issues

Revert an unintentional JDK change

Fix rebase issues

Conceal the exposed Platform API

Conceal the exposed Platform API

Log when EAP

Beautify API & Fix thread safety

[full-line] ML-2987 Extract allowLogging function

[full-line] ML-2987 Log sessions only rarely


Co-authored-by: Petr Surkov <Petr.Surkov@jetbrains.com>

Merge-request: IJ-MR-130436
Merged-by: Gleb Marin <Gleb.Marin@jetbrains.com>

GitOrigin-RevId: 97b462349c7ce6b2186cd6cf6c64f98e7ed0cda7
2024-04-16 15:20:21 +00:00
Gleb.Marin
dd4eeb300e ML-3051 Fix incomplete session logging
Add thread safety

ML-3051 Fix incomplete session logging


Merge-request: IJ-MR-131467
Merged-by: Gleb Marin <Gleb.Marin@jetbrains.com>

GitOrigin-RevId: 5122d0a56e77e5809665202cf8333ccd96775e6f
2024-04-15 18:42:29 +00:00
Gleb.Marin
c320a4a6e7 ML-3051 Fix data race
GitOrigin-RevId: 5efb7e9ee69e253a562ae92d5eb06537dd3b3e68
2024-04-12 18:17:58 +00:00
Gleb.Marin
d3eb49b6f2 ML-3052 Fix invalid main environment passed: "Missing" in the error message
GitOrigin-RevId: 328b007459827285a2e758b8eb77e9bf754a9195
2024-04-12 18:17:58 +00:00
Daniil Ovchinnikov
4369d7df5f IJPL-797 API dump: generate api-dump-unreviewed.txt and exposed API lists [4/4]
GitOrigin-RevId: c48b0b9a6e9596e841dc7928020418b9cd303bcd
2024-04-09 02:21:37 +00:00
Petr Surkov
2bf59d9bba [full-line] ML-2942 Move red code checks and ImportFixer interfaces to ai.impl module
GitOrigin-RevId: 6a55bd0bee8e873c3d1ca3d6d5cbb83672a019be
2024-03-28 15:29:41 +00:00
Gleb.Marin
0c57a9411c [full-line] ML-2929 Fix analysers.kt Default implementation and run analysers in parallel
GitOrigin-RevId: 8d38ea006a6d59a40cf9ce23d68aa6a372d48b58
2024-03-18 19:54:01 +00:00
Gleb.Marin
2f4761f7e2 [ML-2606] ML API: Simplify analysis & usage
Comment out writing logs to file in tests

Fix exposed API

Create event logging test case

Move all analysis methods to one interface

[ML API] Refactor analysis

Split ML session into multiple log events


Merge-request: IJ-MR-128541
Merged-by: Gleb Marin <Gleb.Marin@jetbrains.com>

GitOrigin-RevId: 44cb6ce7bdd3d8337405433e6cbfd9f2baea9265
2024-03-13 12:33:14 +00:00
Gleb.Marin
c5434fd3df [ML-2618] ML API: Use the ML recorder for logging events
Update the group version

Add ML event recorder


Merge-request: IJ-MR-127859
Merged-by: Gleb Marin <Gleb.Marin@jetbrains.com>

GitOrigin-RevId: 6ea502c751a7b47bbe3860caa6209be1f6ef45b4
2024-03-05 13:51:51 +00:00
Gleb.Marin
0f048de5e1 [ML-2843] ML API: Migrate more FLCC features
Conceal platform api

Add "Typing" tier & add more features

Remove empty file

Add debug information to environment extension

Automate description's declaration maximally

Refactor events logging

Add more features from FLCC

Add debug information to ML API

Add utility function for shorter features declarations


Merge-request: IJ-MR-127545
Merged-by: Gleb Marin <Gleb.Marin@jetbrains.com>

GitOrigin-RevId: 8ada4b7e75302f7e0a8d222030e443939487f493
2024-03-04 14:46:57 +00:00
Christian Melchior
70adc89b1b KTNB-155 Add support for creating Light Kotlin Notebook files
This PR adds support for creating "Light Kotlin Notebook" files, which are just like regular Kotlin Notebooks, but are intended for short-lived experiments and therefore live under the "Scratches and Consoles" section.

Merge-request: IJ-MR-125363
Merged-by: Ilya Muradyan <Ilya.Muradyan@jetbrains.com>

GitOrigin-RevId: 4f72e75442cfe673966a50abd201060dc94299ea
2024-03-01 22:58:01 +00:00
Gleb.Marin
16a6bfb27f [ML-2247] Start Trigger Model & Enable FUS
Conceal SessionTree in the ij api

Conceal ml api methods

Conceal ml api methods

Add missing read access

Update fus logs version

Add more features & run API with coroutines

Add some documentation & deprecate old features

Make unused features selection adequate

Fix demo

Add description policy to avoid many explicit nulls

Migrate more FLCC features

Allow any format for prediction & collect context features via API

Run the filter model in PyCharm

Add call parameters concept to the API


Merge-request: IJ-MR-125256
Merged-by: Gleb Marin <Gleb.Marin@jetbrains.com>

GitOrigin-RevId: b2e845e8f3e9ec95c96edf9518cbd9b463bba7ae
2024-02-28 21:05:06 +00:00
Ivan Donchevskii
6a2831f0dd CPP-37343: Support full line completion in CLion Nova
Use the same model but check correctness based on Nova resolve checks.

GitOrigin-RevId: 1e0aa1138bec5055ceaf2a2526d1353642309e46
2024-02-22 17:56:08 +00:00
Mikhail Pyltsin
345e1cc7e9 [java-completion] IDEA-344077, IDEA-343842, IDEA-343839 new transformer for java
- support for generics, empty parameters
- formatting

GitOrigin-RevId: 4f0e392627c0ee6f0965d43110600364472c18de
2024-02-06 14:18:33 +00:00
Gleb.Marin
ef4328d797 [ml] ML-2246 Create a prototype of the common ML API
Fix recursion issue while initializing FUS

Fix project structure

Add ml api initialization logger

Add Api.Internal annotations

Rename a field for better understanding

Add some missing documentation

fixup! Add the API's code documentation
fixup! Add the API's code documentation
fixup! Add the API's code documentation
fixup! Add the API's code documentation
Add analysis of the not started sessions

Add API startup listener & move logger out of approach initialization

Implement API listeners

Add the API's code documentation

Refactor level storage format

Remove redundant changes

Update demo

Fix non logging nested sessions issue

Secure fus logger's initialization

Access the API only via MLApiPlatform

Add model's type & add model analysers

Add double quotes to the code-like categorical feature representation

Allow logging strings from a particular set

In logs, split non-declared features by usage

Acknowledge non declared features in logs

Add tier to logs' tier id

Add environment resolve logic

Update performance task declaration

Enable testing FUS logs

Split MLTask and MLTaskApproach

Add informative failure messages

Replace feature set requirements with feature selectors

Make feature a class

Extend demo a little bit

Remove unchecked cast suppressing

Add type-safe environment initialisation

Add type-safe feature declaration

Add example lookup analysis

Think better about beautiful names

Add item tier && attempt to beautify nested sessions creation

Update demo

Attempt to create another ml api

Merge-request: IJ-MR-125165
Merged-by: Gleb Marin <Gleb.Marin@jetbrains.com>

GitOrigin-RevId: 2aeed3030ab9a5f43e51783fd95c36cda99a18ab
2024-02-02 13:11:00 +00:00
Andrei Efanov
e3c0bbef5d [full-line] docs: add kdoc for CorrectnessChecker and CorrectnessCheckerBase (GO-16057)
GitOrigin-RevId: 836e31edd818d6ce85670483af3968e6e4a42fd5
2024-02-02 00:19:51 +00:00
Adam Malek
17aad50c3b Create a snapshot of list to avoid concurrent modification (IDEA-343644)
GitOrigin-RevId: 3c1dff0ae9e90c43f75244a86bfe7a70f512065b
2024-01-25 00:48:01 +00:00
Adam Malek
432225044f Make prevTokens immutable
GitOrigin-RevId: 93f28073624106f0690bffcb59023af31b11fbde
2024-01-25 00:47:54 +00:00
Vladimir Krivosheev
a920a363f7 IJPL-326 remove getCoroutineScope
GitOrigin-RevId: 071d852d71a7b6a6e5a24088a9bd987fe487f407
2024-01-24 19:51:13 +00:00
Petr Surkov
fcf7a3d554 [full-line] ML-2459 Return PSI from red code analysis (for advanced logs and filter model)
GitOrigin-RevId: 7795992c1009fde0ebeb866b4a10571d444a257d
2024-01-18 19:03:35 +00:00
Petr Surkov
08927e03ae [full-line] ML-2462 Remove outdated TODO
GitOrigin-RevId: 48b2c96d400fb152d06d6ea11bbfe19cebdffa2c
2024-01-18 19:03:35 +00:00
Petr Surkov
cd155240f0 [full-line] ML-2462 Move ErrorsState from platform to Full Line
GitOrigin-RevId: 10bb7835bbca3920bd6032435cde6e629b485ba4
2024-01-18 19:03:35 +00:00
Petr Surkov
a91b54e2a2 [full-line] ML-2462 Squash ErrorsState.Incorrect and Correct into Analyzed
GitOrigin-RevId: 0f132540b84dc361344dc9f575bb479fb0451a53
2024-01-18 19:03:35 +00:00
Petr Surkov
6ffe77bc8f [full-line] ML-2462 Remove useless CodeCorrectness.kt
GitOrigin-RevId: 2ecd2a80f4f7e27a04a6203bc758e2cc9d6b3ac5
2024-01-18 19:03:35 +00:00
Petr Surkov
ceabfd445a [full-line] ML-2462 Remove useless UnknownReason
GitOrigin-RevId: ffb40c3653f6cdb5c66f5e7679f6b7b0ab08b72f
2024-01-18 19:03:35 +00:00
Petr Surkov
c525697834 [full-line] ML-2462 Remove CodeCorrectnessBuilder
GitOrigin-RevId: f499cd62e17c5f82281bc4e351a35cec8a864f30
2024-01-18 19:03:35 +00:00
Petr Surkov
4a1be0355b [full-line] ML-2462 Remove ability to time limit red code analysis
GitOrigin-RevId: c17abb4b34608b8f0071d4511b076f1f22a42983
2024-01-18 19:03:35 +00:00
Petr Surkov
0f0d05787d [full-line] ML-2180 Add debugName to CorrectnessError
GitOrigin-RevId: 81078dab02540b7c1bde863913ca4324b5477a96
2024-01-18 14:50:33 +00:00
Mikhail Pyltsin
169f371aec [java-completion] IJ-CR-123816 IDEA-342465 support correctness for completion
- add lifecycle tests and small fixes

GitOrigin-RevId: c933f9f512bd581dd966ce406f7abe7119ad33fd
2024-01-16 20:06:19 +00:00
Mikhail Pyltsin
9640cd4290 [java-completion] IJ-CR-123816 IDEA-342465 support correctness for completion
- common command for import, merge interface

GitOrigin-RevId: ba1f88fe1ff08c0dc047dcd9ae8400dbf8b7446f
2024-01-16 16:23:48 +00:00
Mikhail Pyltsin
89e37e1371 [java-completion] IJ-CR-123816 IDEA-342465 support correctness for completion
- common command for import

GitOrigin-RevId: ff1a3d300ccd07b61d876cdb7570eea5e4c18836
2024-01-16 11:50:25 +00:00
Mikhail Pyltsin
de83788f8a [java-completion] IJ-CR-123816 IDEA-342465 support correctness for completion
- added inspections

GitOrigin-RevId: d06eb281b8a4f61c9cedcaf7dd40bb11350ac4b5
2024-01-15 22:12:03 +00:00
Aleksandr.Slapoguzov
6d26767084 WI-75764: use LocalQuickFix instead of LocalQuickFixOnPsiElement in InspectionBasedImportFixer
This change is needed to reuse InspectionBasedImportFixer in PHP

GitOrigin-RevId: 964d5a6b9ea41fc71d52900cf99690c2fd485845
2024-01-15 19:34:46 +00:00
Mikhail Pyltsin
82ae6a7e59 [java-completion] IDEA-342465 support correctness for completion
GitOrigin-RevId: e7d3dd5c9afec757fe2fcfb40499f7f174778264
2024-01-12 17:41:48 +00:00
Petr Surkov
e6571d2fc3 [full-line] ML-2050 Make CorrectnessCheckerBase and JSDialectCorrectnessChecker open to fix compilation
GitOrigin-RevId: 50f2a764e24458d3fcf23077b97eeac911584d7e
2023-12-11 11:13:46 +00:00
Petr Surkov
6ea0189200 [full-line] ML-2050 Create two separate functions to find errors in CorrectnessCheckerBase
GitOrigin-RevId: 9af72351028d04b11157d58b95c961e5ebd0de5d
2023-12-11 11:13:46 +00:00
Petr Surkov
d433b10415 [full-line] ML-2050 Add TODOs and annotations
GitOrigin-RevId: 6720d76364e80e19279613fb5c3829d51c4005b5
2023-12-11 11:13:46 +00:00
Petr Surkov
d84c96e01c [full-line] ML-2050 Remove MLCompletionCorrectnessSupporterBase
GitOrigin-RevId: 25c649e6f60490479c34e5ad16c9b1fa06e72a3e
2023-12-11 11:13:46 +00:00
Petr Surkov
76313e4ecb [full-line] ML-2050 Use data object instead of toString
GitOrigin-RevId: f36e3ce3d35073f7ced55716ddb2a6e6cc4b581d
2023-12-11 11:13:46 +00:00
Petr Surkov
29f8d9c358 [full-line] ML-2050 Pass semantic checkers by constructor parameters
GitOrigin-RevId: d40a7b49dd5fdd84c536e0c42620de84c849b65a
2023-12-11 11:13:46 +00:00
Petr Surkov
37cd5f1f6f [full-line] ML-2023 Remove syntax checks from Full Line and platform Red Code
GitOrigin-RevId: b55b969f08a486c7f2d5e1f885a7ea3ab47286cd
2023-12-07 21:52:39 +00:00
Andrey.Matveev
f0bd75eecd PY-64378 Use isLanguageSupported instead of language
GitOrigin-RevId: 2f7cc8a00072ce14deb531101fa3b26928cdb08a
2023-12-07 14:27:08 +00:00
Andrey.Matveev
ebd8ebab42 PY-64378 Move code validation from full line to platform
GitOrigin-RevId: 3e31ea52588a3ee2dde035a149f2e4c45c368b8e
2023-12-07 14:27:08 +00:00
Vladimir Krivosheev
825da47698 use kotlinx serialization
GitOrigin-RevId: 728d7bc3faa3e2ff3ea84bd662bd5d61f8ba2cf6
2023-11-09 10:27:23 +00:00