Summary:
Ensure the AI models powering the platform remain accurate, aligned, and continuously improved to meet business and compliance requirements, while leveraging data science methods to drive insights, performance improvements, and informed decision-making.
Roles & Responsibilities:
1. Conduct monthly fine-tuning of AI models based on customer usage and feedback.
2. Continuously monitor AI outputs for accuracy, fairness, and safety alignment.
3. Develop strategies for handling bias, hallucinations, and compliance issues in AI-generated results.
4. Collaborate with engineers to integrate refined models into production environments.
5. Perform weekly output refinement, including prompt engineering and embedding updates.
6. Design and maintain workflows for AI pipelines and evaluation benchmarks.
7. Ensure AI compliance with organizational, ethical, and regulatory standards (e.g., GDPR, SOC2, Responsible AI principles).
8. Leverage and optimize Azure AI services (OpenAI, Cognitive Search, Document AI, Vector DB, etc.).
9. Analyze datasets to extract insights, build predictive models, and support data-driven decision-making.
10. Design and execute experiments (A/B testing, model evaluation, statistical validation) to improve AI reliability and performance.
11. Design, manage, and optimize ETL pipelines for structured and unstructured data ingestion.
12. Work with big data platforms and Azure Data Lakes to ensure scalable storage, processing, and retrieval
Professional & Technical Skills:
1. Strong background in Machine Learning, NLP, and Data Science.
2. Hands-on experience with Azure AI services (OpenAI, Azure AI Search, Cognitive Search, Document AI).
3. Proficient in Python for AI/ML development, automation, and data pipelines.
4. Practical experience with spaCy, Pandas, NumPy, PyTorch, and advanced text analytics.
5. Knowledge of embeddings, RAG pipelines, vector databases, and fine-tuning methodologies.
6. Strong foundation in statistical modeling, A/B testing, and data visualization.
7. Experience with ETL workflows, big data processing, and Azure Data Lakes.
8. Familiarity with compliance frameworks and AI governance best practices.
9. Strong analytical, problem-solving, and critical-thinking skills.
Educational Qualification:
15 years of full-time education
Shift Timing:
Candidate should be flexible to work in shifts and coming to office.
Location:
Any location in India.