Job Description
As a Data Annotation Specialist, you will play a vital role in refining a large language model (LLM) by creating and assessing pairs of questions and answers. Your primary task will be to generate realistic questions that someone might ask the LLM in real-life scenarios and provide accurate responses.
This involves reviewing guidelines, developing sample prompts and responses in your area of expertise, leveraging your English comprehension skills and domain knowledge in generative LLMs.
Key Responsibilities:
* Annotate Polish and English data accurately and consistently, adhering to predefined annotation guidelines.
* Evaluate existing data resources and machine learning classifier output for quality.
* Develop and maintain guidelines for consistent, high-quality classification and content organization.
* Perform basic research as needed to ensure accurate annotations.
* Provide feedback on annotation tasks and contribute to continuous process improvement.