Files
openide/plugins/evaluation-plugin/evaluationconfig/standaloneexample/config.json
Roman Vasiliev b177803d6f [evaluation-plugin] LME-56 Encapsulate everything project-specific to EvaluationEnvironment and create an example of standalone environment
- introduce DatasetContext for better control over data sources
- extract actions and associated fields like language to an optional config
- create sub-config for standalone datasets
- adapt result report rendering more convenient for csv dataset
- make language configuration optional where possible
- make application lifecycle management more transparent and add sleep for quick runs (intellij can throw errors)
- fix inability to use colons in chunk name


Merge-request: IJ-MR-143249
Merged-by: Roman Vasiliev <Roman.Vasiliev@jetbrains.com>

GitOrigin-RevId: 0b15518f22af27ee9cfb544e99010ec293f31eb5
2024-09-13 18:48:52 +00:00

25 lines
510 B
JSON

{
"outputDir": "ml-eval-standalone-example-output",
"strategy": {},
"fileDataset": {
"url": "./latin_letters.csv",
"chunkSize": 10
},
"interpret": {
"saveLogs": false,
"saveFeatures": false,
"sessionProbability": 1.0,
"sessionSeed": null,
"sessionsLimit": 30,
"filesLimit": 2,
"order": "LINEAR",
"trainTestSplit": 70
},
"reports": {
"evaluationTitle": "Default",
"defaultMetrics": null,
"sessionsFilters": [],
"comparisonFilters": []
}
}