ByteDance

Responsibilities

About the Team

Flow is ByteDance's AI-native innovation business team, focusing on developing products in emerging fields such as LLM. Our product portfolio includes Doubao (China) and Cici (Global). The Model Evaluation Team plays a key role within Flow, providing accurate and timely assessment signals for product iterations. We are responsible for the entire evaluation process, from designing methodology to executing evaluations, identifying issues, and proposing feasible improvement suggestions.

Join us to explore innovative opportunities in AI, grow in a dynamic team environment, and create real value for users!

Responsibilities

• Evaluation Portfolio Management: Strategically oversee prioritization and scheduling of diverse AI/LLM evaluation projects. Ensure quality standards and timely delivery while optimizing resources across multiple concurrent evaluation projects
• Pipeline Optimization: Monitor and enhance human expert evaluation pipelines. Identify bottlenecks, implement operational improvements, and establish robust metrics to track operational effectiveness while maintaining rigorous evaluation standards
• High-complexity Project Execution: Lead execution of critical and complex evaluation projects with a hands-on approach. Apply deep evaluation know-hows and domain expertise to solve sophisticated challenges in LLM capability assessment
• Team Leadership & Development: Guide and mentor evaluation specialists to enhance their capabilities and professional growth. Initiate team building initiatives that strengthen collaboration, evaluation quality and efficiency
• Operational Excellence: Foster cross-functional partnerships while promoting advanced evaluation methodologies. Support team adoption of state-of-the-art approaches across specific domains to capture authentic user perspectives

Qualifications

Minimum Qualifications

• Bachelor's degree or above in Business Administration, Project Management, Engineering, or related fields
• 5+ years of experience in program/project management, operations, or strategy roles in technology companies
• Strong program management capabilities with the ability to drive multiple projects simultaneously
• Excellent stakeholder management and communication skills
• Quick adaptation to new tools, methodologies and operational concepts

Preferred Qualifications

• Experience managing teams or leading critical cross-functional projects in fast-paced, dynamic environments
• Proven track record in internal process optimization and efficiency improvement
• Hands-on experience with AI/ML operation workflows
• Genuine passion for AI/LLM technologies