Embark on a Data Infrastructure Journey with Me!
Greetings, data enthusiasts and trailblazers! š I'm on a mission to revolutionize data architecture and redefine the possibilities of data engineering. With a wealth of experience in modern Data Engineering tools, Databricks, and AWS cloud services.
Why Choose Me?
I excel in designing secure, internet-free architectures using VPC endpoints for connectivity. With expertise in Databricks and AWS, I spend most of my time writing Terraform code to create robust data architecture templates. By implementing Terraform export from Databricks Workspace and using GitHub action workflows, I've slashed development time by 50%.
Key Skills and Achievements:
ā¢ Developed a low-code UI platform for Terraform deployment.
ā¢ Leveraged Databricks Unity Catalog for data governance and user management, ensuring fine-grained access control.
ā¢ Established efficient CI/CD pipelines using workflows and repositories for ETL processes.
ā¢ Utilized PySpark and Spark SQL for sophisticated data transformations.
Let's Build the Future Together!
Connect with me for Data Excellence and Beyond!More...