Skip to main content
Autodesk

Principal Knowledge Automation Analyst

RemotePoland only
Published
Role
Fullstack
Experience
Principal
Employment
Full-time
PLN 187.5k–PLN 275k/yr
Check eligibility

Open to PL only. Set where you work from to check your eligibility.

Core skills

Knowledge management platforms/Confluence/SharePoint/Notion Enterprise/Gainsight Knowledge/Guru

Required skills

AI / LLM/OpenAI / AzureOpenAI/Anthropic Claude/Google GeminiAgentic Workflow & Orchestration/ReAct (Reason + Act)/Chain of Thought (CoT) patternsChain of Thought (CoT)AI Operations/Prompt design and evaluation/LLM output evaluation and benchmarking/Model monitoring and QA/RAG evaluation frameworks/RAGAS/retrieval observability tools/LangSmith/TruLens/Vector Databases/Markdown filesMarkdownKnowledge Modeling & Semantic Technologies/Taxonomy and ontology management platforms/Semaphore/PoolParty/knowledge graphs/entity resolution and semantic enrichment tools/graph exploration platforms/Neo4j Bloomentity resolution toolssemantic enrichment toolsAI Extraction & Document Processing/Unstructured.io/LlamaParse/document intelligence and content extraction platformsdocument intelligence platformscontent extraction platformsCloud environments/Azure/AWS/Google

What you'll do

  • Design and operate AI-powered pipelines to capture knowledge from enterprise systems, meeting transcripts, and engagement artifacts
  • Define and evolve the conceptual knowledge model, including key entities, relationships, and ontology governance required to organize and retrieve implementation knowledge at scale
  • Manage and optimize AI agents, including prompt design, evaluation, and performance tuning
  • Define content-type-specific chunking strategies for consulting artifacts and work with Engineering to implement retrieval-ready knowledge structures
  • Define requirements and participate in embedding and vectorization evaluation to ensure captured knowledge can be effectively discovered through semantic search and AI-powered retrieval
  • Define and track quality metrics (accuracy, completeness, error rates) and continuously improve pipeline performance
  • Ensure secure handling of sensitive information, including automated redaction and compliance with governance standards
  • Design and operate pipelines that convert raw, unstructured inputs into structured, template-aligned outputs using AI
  • Map extracted knowledge to defined content model fields, ensuring outputs are complete, consistent, and production-ready
  • Define structured capture methods (forms, schemas, workflows) to ensure key context (decisions, constraints, trade-offs) is captured
  • Normalize and standardize data across sources and identify gaps to improve capture and transformation processes
  • Define entity resolution and canonicalization rules to ensure concepts, terminology, and implementation knowledge are consistently represented across sources
  • Ensure structured outputs support AI-driven use cases including vector search, retrieval-augmented generation (RAG), knowledge graph navigation, and downstream content generation
  • Partner with the Content Model Lead to align transformation outputs with templates and structures
  • Collaborate with Architecture and Engineering to align knowledge models, retrieval pipelines, and platform data models
  • Define evaluation criteria for retrieval effectiveness, semantic relevance, and answer quality, and continuously improve knowledge performance

What they require

  • 8+ years of experience in knowledge management, information architecture, information systems, semantic technologies, data engineering, or related field
  • Experience working with AI/LLM-based workflows in production
  • Experience designing data pipelines, structured capture, or transformation processes
  • Ability to define and improve quality metrics
  • Experience working cross-functionally with product, engineering, and domain experts
  • Experienced in using related technologies

Benefits

  • Salary is part of Autodesk's competitive compensation package
  • May include annual cash bonuses, stock grants, and a comprehensive benefits package
  • Flexible / remote work

Welcome to Autodesk! Amazing things are created every day with our software - from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.

🇺🇸 United StatesSoftwareautodesk.com/
PLN 187.5k–PLN 275k/yr