Website Creative Planning
The Data Engineer will have an essential role in shaping the firm’s data ecosystem. This
means understanding all aspects of the data we collect, where it’s stored, how it’s used, and
the calculations applied in reporting. You will also support the ongoing development of our
data lake and data applications. With a focus on building scalable, robust, and efficient data
systems, your work will be instrumental in helping drive business intelligence, analytics, and
operational excellence.
Responsibilities
• Support the ongoing development of our Azure Databricks Lakehouse, ensuring that
data ingestion, storage, and access align with best practices for data management
and scalability.
• Optimize database performance and ensure reliability. Implement indexing and query optimization best practices for efficient data retrieval.
• Design, build, and deploy data extraction, transformation, and loading processes
and pipelines from various sources, including databases, APIs, and data files.
• Manage data pipelines for both analytics and operational use, ensuring that data is
reliably available for critical applications.
• Ensure data accuracy and integrity across multiple sources and systems, proactively
resolving discrepancies and improving data quality.
• Develop and deploy structured, semi-structured, and unstructured data storage
models (such as data vault or dimensional modeling) on various platforms to meet
business requirements.
• Coordinate with responsible teams to implement security, application monitoring,
and other capabilities, ensuring consistency and compliance across all data systems.
• Author and maintain clear, concise, and up-to-date documentation for processes,
procedures, and technical designs.
• Improve data systems, identify opportunities for optimization, and ensure that solu-
tions scale efficiently as business needs change.
Qualifications
• Bachelor’s degree in Computer Science, Information Technology, or a related field.
• Experience working with relational databases and applying them in various applications, including on the Microsoft Azure platform.
• Experience designing and developing both on-premises and cloud-based (Azure) infrastructure and platform components.
• Experience developing and deploying solutions on the Azure cloud using .NET, Azure
Storage, Data Factory, DevOps, and Pipelines.
• Proficient with Databricks and familiar with data transformation processes for largescale data environments.
• Knowledge of database technologies including Microsoft SQL Server and NoSQL databases.
• Advanced programming skills in multiple languages.
• Experience with Power BI is a plus.
• Strong attention to detail.
• Ability to work in a fast-paced environment.
• Ability to work independently and collaboratively in a team environment.
• Commitment to teamwork and excellence.
• Motivated and results oriented.
• Available to work outside of normal business hours when required.
To apply for this job email your details to careers@creativeplanning.com
