Experience in Cloud Data Pipelines

Building cloud data pipelines involves using Azure native programming techniques such as PySpark or Scala and Databricks. These pipelines are essential for tasks like sourcing, enriching, and maintaining structured and unstructured data sets for analysis and reporting. They are also crucial for secondary tasks such as flow pipelines, streamlining AI model performance, and enhancing interaction with LLM-based systems.

Key Skills and Experiences

• Strong programming experience in Python
• Proven experience working on the MS Azure cloud platform and its native tech stack in designing and building data & AI solutions
• Experience with data modeling, ETL processes, and data warehousing
• Knowledge of big data tools and frameworks such as Spark, Hadoop, or Kafka