Information Specialist - Freelance AI Trainer Project

<h3><strong>Project Overview</strong></h3> <p>We are sourcing independent Information Specialists to provide their expertise for an AI benchmark evaluation project. As AI models increasingly generate professional-grade data management strategies, information retrieval systems, and content architecture deliverables, their accuracy relies entirely on robust, expert-crafted training data. The objective of this project is to autonomously produce high-quality evaluation tasks, strong prompts, and clear, well-structured rubrics that generate clean, reliable data for model training.</p> <h3><strong>Project Deliverables &amp; Scope</strong></h3> <p>Operate autonomously to design complex evaluation frameworks and provide structured training data. Expected deliverables include:</p> <ul> <li><strong>Task &amp; Prompt Creation:</strong> Generating realistic, high-quality prompts that compel the AI model to produce complex, professional-grade deliverables specific to information science, data management, and knowledge organization.</li> <li><strong>Rubric Development:</strong> Writing clear, well-structured evaluation rubrics with criteria that are highly specific, non-ambiguous, and easy to score.</li> <li><strong>Benchmark Evaluation Data Generation:</strong> Producing clean, reliable training data that directly aids in the evaluation and refinement of AI models handling complex information architecture and retrieval tasks.</li> <li><strong>Quality Assurance &amp; Fact-Checking:</strong> Ensuring all generated tasks and scoring criteria reflect strict, real-world data governance standards, research methodologies, and information management best practices.</li> </ul> <h3><strong>Required Expertise</strong></h3> <p>To successfully fulfill the deliverables of this project, Contractors must possess deep industry knowledge to craft realistic professional scenarios.</p> <p><strong>Core skillset includes:</strong></p> <ul> <li>Demonstrable professional expertise within the information science, library science, data governance, or knowledge management sectors, with a deep understanding of industry standards, metadata schemas, and search methodologies.</li> <li>Strong writing and prompt generation skills, with the ability to design highly realistic, complex information retrieval task scenarios for AI evaluation.</li> <li>Proficiency in rubric generation, specifically the ability to create objective, non-ambiguous scoring criteria that leave no room for subjective interpretation.</li> <li>A meticulous, detail-oriented approach to fact-checking data architectures, search mechanics, and knowledge bases to generate reliable data for system benchmarking.</li> </ul>