Task | Parrotlet-V (Eka Care’s LLM) | OpenAI GPT-4o | Claude Sonnet 3.5 | Qwen2-VL (7B) | Llama-3.2-Vision (11B) | Phi-3.5-vision (4.2B) |
---|---|---|---|---|---|---|
PII extraction | 0.915 | 0.884 | 0.824 | 0.719 | 0.541 | 0.585 |
Field Name | Parrotlet-V | GPT-4o | Claude Sonnet 3.5 |
---|---|---|---|
name | 0.954 | 0.929 | 0.93 |
age | 0.955 | 0.894 | 0.619 |
gender | 0.973 | 0.978 | 0.95 |
dob | 0.974 | 0.973 | 0.956 |
facility | 0.899 | 0.796 | 0.729 |
document_date | 0.947 | 0.955 | 0.951 |
doctor | 0.704 | 0.665 | 0.634 |
Average | 0.915 | 0.884 | 0.824 |