Information Architect — SoTalent, New York, NY

Junior Information Architect (Remote)

Location: New York City, New York, United States

Industry: Technology, Information and Internet

Work Setting: Remote

Are you passionate about evaluating AI-generated content, ensuring quality at scale, and helping improve the next generation of intelligent technologies? We are seeking an AI Content Quality Analyst to assess AI-generated outputs across text, images, videos, and documents, providing detailed feedback that enhances the accuracy, consistency, and usefulness of advanced AI systems.

In this role, you will apply critical thinking, attention to detail, and strong communication skills to evaluate content against established guidelines and quality standards. Your feedback will directly contribute to improving AI model performance and real-world user experiences.

Key Responsibilities

AI Content Evaluation

• Review and evaluate AI-generated content across multiple formats, including:

• Text

• Images

• Video

• Documents

• Assess outputs against predefined quality standards and evaluation criteria.

• Identify errors, inconsistencies, inaccuracies, and quality concerns.

• Ensure evaluations are objective, consistent, and aligned with project requirements.

Quality Assurance & Review

• Perform detailed quality assessments of AI-generated responses and content.

• Validate content accuracy, relevance, completeness, and usability.

• Detect defects and issues that may impact user experience or system performance.

• Maintain high standards of evaluation accuracy and consistency.

Analysis & Critical Thinking

• Apply analytical reasoning when reviewing outputs and making quality judgments.

• Compare content against guidelines, requirements, and expected outcomes.

• Evaluate both technical and creative outputs using structured assessment methodologies.

• Use sound judgment to determine content quality and effectiveness.

Documentation & Feedback

• Provide clear, detailed, and well-supported explanations for evaluation decisions.

• Write concise and accurate justifications that help improve AI performance.

• Document findings and recommendations according to project standards.

• Ensure all evaluations include meaningful and actionable feedback.

Guideline Compliance

• Follow detailed written instructions and evaluation frameworks.

• Interpret project requirements and consistently apply established standards.

• Maintain adherence to quality control procedures and operational guidelines.

• Adapt quickly to evolving evaluation criteria and project requirements.

Continuous Improvement

• Contribute to the development of more accurate and reliable AI systems.

• Identify recurring issues and quality trends within AI-generated content.

• Support ongoing optimization of evaluation processes and methodologies.

• Stay current with AI content evaluation best practices and industry developments.

Required Qualifications

• Bachelor's degree (completed or currently in progress).

• Strong written and verbal English communication skills.

• Exceptional attention to detail.

• Ability to follow detailed written instructions independently.

• Strong analytical and critical-thinking capabilities.

• Ability to provide objective evaluations and defend decisions with clear reasoning.

Preferred Experience

• 1+ year of experience in roles involving content evaluation, quality review, or standards-based assessment, including:

• Quality Assurance (QA)

• Editorial Review

• Technical Writing

• Research

• UI/UX Design

• Graphic Design

• Photography

• Video Production

• Content Moderation

• Documentation Review

• Requirements Analysis