GSoC Week 12: A Deep Dive Into Evaluation, and Publishing Everything
Investigating why IndIE's BenchIE score looked wrong, closing out the property audit, and publishing all models and datasets.
Investigating why IndIE's BenchIE score looked wrong, closing out the property audit, and publishing all models and datasets.
Establishing real baselines against IndIE and testing the pipeline on Gujarati and Rajasthani.
Being precise about how every evaluation number is actually calculated, and testing whether few-shot prompting helps.
Full-scale evaluation across the entire dataset, plus rebuilding the human review tool around real pipeline data.
Comparing embedding models for ontology alignment and building the first version of the human review tool.
Third week of the coding period, auditing the existing training dataset and building the ontology alignment layer.
Second week of the coding period, researching data requirements for fine-tuning and looking into annotation tooling.
First week of the coding period, understanding the existing DBpedia Hindi Chapter pipeline and prior GSoC work.