RolmOCR

Description

RolmOCR is an advanced OCR tool developed by Reducto AI, designed to enhance document parsing capabilities using the Qwen2-VL-7B vision language model. Released under the Apache 2.0 license, RolmOCR serves as a drop-in alternative to the earlier olmOCR, offering improved speed and reduced memory usage. This tool is particularly effective in processing complex documents such as PDFs, without relying on metadata inputs, which helps in reducing prompt length and VRAM usage while maintaining accuracy.

The development of RolmOCR involved significant changes, including the use of a newer base model, Qwen2.5-VL-7B, and the rotation of 15% of the training data to improve robustness against off-angle documents. Despite these enhancements, RolmOCR shares some limitations common to VLM-based OCR solutions, such as potential hallucinations or content omissions. Additionally, it does not support layout bounding boxes, unlike the Reducto Parsing API.

RolmOCR is suitable for users looking for an efficient and open-source solution for document OCR tasks. It can be hosted with vLLM and accessed via an OpenAI-compatible server, making it versatile for various applications. While quantized versions have not been evaluated, the tool's open-source nature allows for further exploration and development by the community.

RolmOCR Highlights

• Open-source OCR tool

• Uses Qwen2-VL-7B model

• Faster processing

• Reduced memory usage

• No metadata inputs

• Apache 2.0 license

• Robust to off-angle documents

• Compatible with OpenAI server

Getting Started with RolmOCR

1. 1

   Access page: Visit the Hugging Face model page

2. 2

   Load model: Initialize RolmOCR on your environment

3. 3

   Configure environment: Set up vLLM hosting

4. 4

   Integrate: Connect via OpenAI-compatible server

5. 5

   Fine-tune: Adjust model settings for specific tasks

RolmOCR's Use Cases

• Document parsing
• Memory optimization
• Open-source development
• Off-angle document handling
• Integration with OpenAI

FAQ from RolmOCR

• What is RolmOCR?

  RolmOCR is an open-source OCR tool developed by Reducto AI, offering faster processing and lower memory usage.

• How does RolmOCR differ from olmOCR?

  RolmOCR uses a newer base model and does not rely on metadata inputs, reducing prompt length and VRAM usage.

• What are the limitations of RolmOCR?

  RolmOCR may experience hallucinations or content omissions and does not support layout bounding boxes.

• Can RolmOCR be used for off-angle documents?

  Yes, RolmOCR is robust to off-angle documents due to rotated training data.

• Is RolmOCR open source?

  Yes, RolmOCR is released under the Apache 2.0 license.

• How can RolmOCR be hosted?

  RolmOCR can be hosted using vLLM and accessed via an OpenAI-compatible server.

• What dataset was used to train RolmOCR?

  RolmOCR was trained on the allenai/olmOCR-mix-0225 dataset.

• Does RolmOCR support quantized versions?

  Quantized versions of RolmOCR have not been evaluated.