Senior Data Engineer

Job Requisition ID # 26WD98492 Position Overview As a Senior Data Engineer, you will build the foundations that enable data driven marketing and the digital transformation journey at Autodesk. You will work with data strategists to understand the business requirements and execute the tactical aspects of delivering on the vision. Your team will drive multiple tool selection initiatives, ingesting data from different source systems to the data lake, Data Wrangling to enable downstream data consumers, developing systems & processes to improve data reliability, developing a comprehensive data catalog and training downstream data consumers. You will report to Manager, Data Engineering. This is a hybrid position in Bengaluru.

Create and maintain optimal data pipeline architecture. Assemble complex data sets that meet functional/non-functional requirements Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, dbt, and AWS 'big data' technologies Design and build scalable, secure, and governed data products and pipelines that enable Analytics, ML, Generative AI, and LLM-based applications Work with structured and unstructured data and apply modern approaches such as semantic layers, embeddings, vector search, and Retrieval-Augmented Generation (RAG), while ensuring data quality, lineage, observability, security, and responsible AI practices Enable and contribute to production-grade Agentic AI solutions by designing reliable data services, APIs, semantic models, and tool interfaces that allow AI agents to securely discover, retrieve, reason over, and act on enterprise data. Experience with agent orchestration, tool/function calling, MCP, context and memory management, evaluation, guardrails, and observability is highly desirable Build analytics tools that utilize the data pipeline to provide actionable insights into employee experience, operational efficiency, and other key business performance metrics Work with stakeholders to assist with data-related technical issues and support associated data infrastructure needs Build processes supporting data transformation, data structures, metadata, dependency, and workload management Keep up to date with the latest and greatest in feature-sets and capabilities from public cloud providers (such as AWS and Azure) and find ways to apply them back to help their team Work with data scientists and analysts to strive for greater functionality in our data systems Minimum Qualifications We are looking for a candidate with 5+ years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. 5+ years of hands-on experience in Snowflake Mandatory 5+ years of working in dbt with knowledge on advanced dbt concepts like macros and Jinja templating Advanced working SQL experience working with relational databases, query authoring (SQL) and working familiarity with a variety of databases Experience with scripting languages such as Python Experience with big data tools such as PySpark Experience with AWS cloud services used often for data engineering including S3, EC2, Glue, Lambda, RDS, or Redshift Experience working with APIs to pull and push data Experience optimizing 'big data' data pipelines, architectures and data sets. Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement Able to read existing code to understand functionality and debug issues Preferred Qualifications Experience working with Marketing Domain knowledge will be highly preferred Familiarity with Agile methodologies is a plus