Peter Daniels，美国科罗拉多州丹佛市的开发商
Peter is available for hire
Hire Peter

Peter Daniels

Verified Expert  in Engineering

Database Engineer and Developer

Location
Denver, CO, United States
Toptal Member Since
September 18, 2023

Peter is a seasoned data platform expert specializing in the Microsoft stack, including Azure. With skills ranging from data architecture and engineering to database administration and development, his 29 years of experience, multiple certifications, 对学习的热情使他在满足客户不同的数据需求方面脱颖而出. Most recently, Peter helped a growing company migrate their on-premise data and AI estate into Azure as part of an ERP migration to Microsoft Dynamics 365.

Data WarehousingData ModelingData AnalyticsData AnalysisData EngineeringData MigrationData Warehouse DesignCloudDatabase DesignSQL Server DBADatabase DevelopmentSQL Server Integration Services (SSIS)SQLMicrosoft SQL ServerDatabase ArchitectureAzure SQLAzure Blob StorageLotus NotesMicrosoft Dynamics GPData LakehousePower BIKornShellAzureAzure SynapseAzure Data Factory

Portfolio

Teel Inc.
SQL, Microsoft SQL Server, MySQL, Docker, SQL Server 2017, Python 3, Python...
SQL Sanity
SQL Server DBA，数据架构，ETL，商业智能，自动化...
CRB Group
Azure SQL, SQL Server BI, SQL Server DBA, Windows PowerShell, Python, Synapse...

Experience

Database Design - 20 yearsData Warehousing - 20 yearsData Architecture - 20 yearsData Modeling - 20 yearsDatabase Development - 20 yearsWindows PowerShell - 8 yearsAzure - 7 yearsSynapse - 3 years

Availability

Part-time

Preferred Environment

SQL Server BI, Azure, Database Design, Data Engineering, Data Warehousing, Azure Data Lake, Windows PowerShell, SQL, Azure Synapse, Data Architecture

The most amazing...

...project I've done is migrate a complex data and AI estate to Microsoft Azure cloud for CRB Group, 优化Azure SQL数据仓库的数据流.

Work Experience

ETL Developer

2023 - PRESENT
Teel Inc.
  • Developed a data migration tool in Python to migrate application data from MS SQL Server to MySQL in a Docker container.
  • 使用了pandas、SQLAlchemy和其他Python包.
  • 与终端客户(Teeltech的客户)合作，了解需求, coordinate testing, and troubleshoot issues.
  • Navigated the challenges involved in a secure target environment in which we had very limited visibility.
Technologies: SQL, Microsoft SQL Server, MySQL, Docker, SQL Server 2017, Python 3, Python, Visual Studio Code (VS Code), Windows PowerShell, Pipelines, Data Processing, English, Query Optimization, CSV Export, Data Pipelines, Database Administration (DBA), Databases, Amazon Web Services (AWS), DevOps, ETL Tools, Advisory, Data, Databricks, Azure Databricks

President | Principal Engineer | Data Architect

2007 - PRESENT
SQL Sanity
  • 2007年成立咨询公司，为客户提供咨询服务.
  • 设计和开发了许多数据库，主要是为Microsoft SQL Server量身定制的.
  • 使用Microsoft SQL Server为多个客户端执行数据库管理任务.
Technologies: SQL Server DBA，数据架构，ETL，商业智能，自动化, Database Architecture, Data Migration, Cloud, Microsoft Azure, T-SQL (Transact-SQL), Data Engineering, Python, Database Development, SQL, Database Modeling, Microsoft SQL Server, ETL Development, Data Lakes, Data Warehouse Design, REST APIs, Unstructured Data Analysis, Pipelines, Data Analysis, Data Analytics, Data Processing, English, Query Optimization, CSV Export, Data Pipelines, Database Administration (DBA), Database Migration, Databases, Data Strategy, DevOps, ETL Tools, APIs, Advisory, Consulting, Large-scale Projects, Big Data, Data, Data Visualization, Azure Blob Storage API, Azure Databricks

Senior Data Architect | Consultant

2016 - 2023
CRB Group
  • 使用Azure SQL将公司的数据架构迁移到Azure, Synapse, Azure Data Lake Storage Gen2, and Azure Data Factory, optimizing Microsoft Dynamics 365 data ingestion, Azure SQL Data Warehouse (SQL DW) loading, and Power BI consumption.
  • Implemented ingestion processes from Microsoft Dynamics 365 into a data lake using Azure Synapse Link and Export, enabling data analysts to utilize familiar Synapse serverless views and external tables for streamlined data warehouse ETL.
  • 将Azure订阅迁移到新的Azure Active Directory租户. 通过更改现有订阅上的租户，而不是重新定位资源, CRB saved significant time and costs, 总共花费了数百小时和数万美元.
  • Provided individual mentoring to fellow data team members and facilitated Azure data exploration meetings. Fostering team growth contributed to CRB's ability to meet the demands of a growing business.
  • 使用Azure DevOps实现数据库、Synapse源代码控制和CI/CD进程. This streamlined a dependable change management system for CRB's data and AI infrastructure, 使多个工程师和分析师能够无缝协作.
  • Stabilized and managed CRB's SQL Server estate and implemented Redgate SQL for monitoring. Transitioning from constant troubleshooting to a robust data environment enabled CRB's data team to concentrate on delivering new business value.
  • Created a PowerShell utility to export files stored in an SQL Server database to a file system (shares) where they could be archived and shared.
  • Developed PowerShell tools to facilitate migrating SQL Server databases to new servers in a new AD domain.
Technologies: Azure SQL, SQL Server BI, SQL Server DBA, Windows PowerShell, Python, Synapse, Azure Data Factory, Azure Synapse, Delta Lake, Microsoft Power BI, SQL Server Integration Services (SSIS), Azure Data Lake, Spark, ETL, Business Intelligence (BI), PySpark, Automation, Database Architecture, Data Migration, Cloud, Microsoft Azure, T-SQL (Transact-SQL), Data Engineering, Database Development, SQL, Database Modeling, Microsoft SQL Server, ETL Development, Data Lakes, Data Warehouse Design, REST APIs, Unstructured Data Analysis, Pipelines, Data Analytics, Data Processing, English, Query Optimization, CSV Export, Data Pipelines, Database Administration (DBA), Database Migration, Databases, Cloud Migration, Data Strategy, DevOps, ETL Tools, APIs, Advisory, Consulting, Large-scale Projects, Big Data, Data, Data Visualization, Databricks, Azure Blob Storage API, Azure Databricks

开发数据库管理员|数据库管理员顾问|数据架构师

2005 - 2019
InComm
  • Designed and built many SQL Server databases to complement software development initiatives, 支持InComm的基础运营和不断增长的业务努力. 这些应用程序中的许多继续在生产中运行.
  • Designed and implemented database source control, change management, and deployment processes, giving InComm confidence in deploying their applications and associated database changes to production.
  • Facilitated meetings between operations and development database administrator (DBA) teams, 帮助打破竖井并鼓励团队之间的更多协作.
  • Aided multiple software development teams by reviewing database designs and SQL migration scripts to support their development processes.
  • 实现了多个SQL Server数据库的复制. Often, 这用于将报告与生产数据库的复制副本隔离开来, 减少从生产数据库报告查询的影响.
  • Triaged production database issues to help InComm resolve problems quickly and efficiently.
Technologies: SQL Server DBA, Data Architecture, Database Design, SQL Server Integration Services (SSIS), SQL Server Reporting Services (SSRS), Data Modeling, MySQL, Database Replication, Windows PowerShell, Data Warehousing, ETL, Business Intelligence (BI), Automation, Database Architecture, Data Migration, Microsoft Azure, T-SQL (Transact-SQL), Database Development, SQL, Database Modeling, Microsoft SQL Server, ETL Development, Pipelines, Data Analysis, Data Analytics, Data Processing, English, Query Optimization, CSV Export, Data Pipelines, Database Administration (DBA), Database Migration, Databases, PostgreSQL, DevOps, ETL Tools, Advisory, Large-scale Projects, Data, Data Visualization, Retail & Wholesale

Data Architect | Database Administrator Consultant

2011 - 2015
Coinstar
  • Managed SQL Servers and databases to facilitate a gift card purchasing system initiated by Alula, a pilot venture of Coinstar. 这些SQL Server实例托管在AWS Windows虚拟机上.
  • Designed and developed the SQL Server databases to support the gift card purchasing system.
  • Designed and implemented data architecture to facilitate reporting isolation using SQL Server replication.
Technologies: SQL Server 2010, SQL Server 2012, SQL Server 2014, Database Design, SQL Server DBA, Data Modeling, SQL Server Reporting Services (SSRS), Database Replication, ETL, Business Intelligence (BI), Automation, Database Architecture, T-SQL (Transact-SQL), Database Development, SQL, Database Modeling, Microsoft SQL Server, ETL Development, Data Warehouse Design, Pipelines, Data Analysis, Data Analytics, Data Processing, English, Query Optimization, CSV Export, Data Pipelines, Database Administration (DBA), Database Migration, Databases, Amazon Web Services (AWS), ETL Tools, Advisory, Consulting, Large-scale Projects, Data, Data Visualization, Retail & Wholesale

Data Architect | Data Engineer | Consultant

2008 - 2009
Batmann Consulting
  • 设计并实现了一个数据仓库来支持服务调用报告解决方案, which helped its client, Comcast, reduce in-person service visits by 15%.
  • 开发ETL，从各种来源获取Comcast服务呼叫数据, predominantly Oracle, into an SQL Server data warehouse.
  • Created custom, metadata-driven SQL Server Integration Services (SSIS) tasks to make ETL processes more flexible, efficient, and extensible.
Technologies: SQL Server BI, SQL Server 2005, SQL Server 2008, Oracle, SQL Server Integration Services (SSIS), ETL, Business Intelligence (BI), Database Architecture, T-SQL (Transact-SQL), Database Development, SQL, Database Modeling, Microsoft SQL Server, ETL Development, Data Warehouse Design, Pipelines, Data Analysis, Data Analytics, Data Processing, English, Query Optimization, CSV Export, Data Pipelines, Database Administration (DBA), Databases, ETL Tools, Advisory, Consulting, Large-scale Projects, Big Data, Data, Data Visualization

高级数据库管理员|数据架构师| BI架构师

2006 - 2007
Statera
  • 将基本的供应链整合工具发展为SSIS, 提供一个更可靠和更好监测的系统.
  • 协助其他DBA处理日常的SQL Server管理任务.
  • 开发Statera的BI实践和行业指标清单文档.
Technologies: SQL Server 2005, SQL Server Integration Services (SSIS), SQL Server Analysis Services (SSAS), ETL, Business Intelligence (BI), Data Migration, T-SQL (Transact-SQL), Data Engineering, Database Development, SQL, Database Modeling, Microsoft SQL Server, ETL Development, Data Warehouse Design, Pipelines, Data Analysis, Data Analytics, Data Processing, English, Query Optimization, CSV Export, Data Pipelines, Database Administration (DBA), Databases, ETL Tools, Advisory, Consulting, Large-scale Projects, Data

Senior Development Database Administrator

2003 - 2005
eCollege
  • Implemented database source control at eCollege, 帮助开发人员有效地管理可编程对象和模式迁移.
  • Developed a database to support Sharable Content Object Reference Model (SCORM) technologies.
  • Supported the management of development and test SQL Servers for various development teams.
Technologies: SQL Server 2000, C#.NET, T-SQL (Transact-SQL), Database Development, SQL, Database Modeling, Microsoft SQL Server, Data Processing, English, Query Optimization, CSV Export, Data Pipelines, Database Administration (DBA), Databases, Data

Database Administrator | Data Architect

2002 - 2003
Cendant Travel Services
  • 支持多个团队的SQL server的生产和开发.
  • Implemented Cendant's first SQL Server clusters, 显著提高其可用性和可靠性.
  • 开发了用于访问数据层数据库的软件架构.
Technologies: SQL Server 2000, Sybase, Visual Basic 6 (VB6), T-SQL (Transact-SQL), Database Development, SQL, Database Modeling, Microsoft SQL Server, Data Processing, English, Query Optimization, CSV Export, Data Pipelines, Database Administration (DBA), Databases, Data

软件工程师|数据库管理员|数据库开发人员

1998 - 2002
School Link Technologies
  • 设计并开发了SQL Server数据库来支持myLunchMoney.com website.
  • Developed migration tools to help customers migrate from Microsoft Access to Microsoft SQL Server.
  • Developed database migration tools to ensure the dependable installation and updates of customer databases at School Link Technologies. 该软件验证了数据库版本的兼容性，确保无缝操作.
Technologies: C++, SQL Server 2000, Visual Basic 6 (VB6), T-SQL (Transact-SQL), Database Development, SQL, Database Modeling, Microsoft SQL Server, Data Processing, English, Query Optimization, CSV Export, Data Pipelines, Database Administration (DBA), Databases, Large-scale Projects, Data

Software Developer | Data Warehouse Developer

1997 - 1998
US West
  • 创建了一个ETL进程，将网络监控数据加载到数据仓库中.
  • 使用Perl将SQL结果转换为网页上的HTML表.
  • 为网络监控数据开发SQL报表.
Technologies: Oracle8i, HTML, Perl, ETL, Database Development, SQL, Database Modeling, ETL Development, Data Warehouse Design, Data Processing, English, Query Optimization, CSV Export, Data Pipelines, Databases, Data

Database Administrator

1996 - 1997
Tsunami Consulting | CSC | BLM
  • 监督数据库及其服务器的开发和测试.
  • 合作开发基于kornshell的数据库修补工具.
  • 为软件开发人员和数据库管理员优化了SQL性能.
Technologies: IBM Informix, Unix Shell Scripting, SQL, Data Processing, English, CSV Export, Database Administration (DBA), Databases, Data

Software Developer

1995 - 1996
US West
  • Developed Visual Basic (VB) software that enabled customer service representatives to load images of Yellow Pages contracts when receiving customer calls.
  • Created software to scan Yellow Pages contracts, save the images, 并将它们存储在一个中心位置，以便于检索.
  • 建立了合同文件元数据的标准化语言.
技术:Visual Basic, Microsoft Visual c++，英语，数据

Lotus Notes Developer and Administrator

1994 - 1995
Grey Wolf Systems
  • 用于各种客户机的托管Lotus Notes基础设施.
  • 为客户机开发自定义Lotus Notes应用程序.
  • 通过认证改进公司的Lotus Notes实践.
Technologies: Lotus Notes, English, Data

New Data Warehouse Architecture

为数据仓库和报表设计并实现了一个新的云数据架构. Moving the client's estate to the cloud was driven by moving their ERP to Dynamics 365 and utilizing existing Power BI service resources.

Data Factory Metadata-driven ETL

Designed an ETL platform streamlining the export of data from diverse on-premise SQL Servers and databases into a centralized data lake. 开发人员可以毫不费力地合并新的服务器, databases, and tables or queries into the system, 使用ETL自动化向数据湖的导出过程.

Synapse Link and Export to a Data Lake

Implemented Azure Synapse Link for Dataverse to synchronize Dynamics 365 data with Synapse serverless, 为ETL开发人员提供数据仓库ETL的可访问表. Also, I implemented Export to the data lake for Dynamics 365 apps incompatible with Synapse Link.

Document Export Utility

Designed and developed a PowerShell tool to efficiently export files from an SQL Server database to designated file shares. This streamlined file sharing and archiving and contributed to optimizing storage space within the SQL Server database for the customer.

Database Design

Designed numerous SQL Server databases catering to diverse applications throughout my career. 值得注意的项目包括宽带激活系统, an automated clearing house (ACH) processing system, a gift card purchasing system, a network monitoring data warehouse, a human resources data warehouse, and an enterprise data warehouse. Proficiency in both online transaction processing (OLTP) and online analytical processing (OLAP) modeling is second nature to me.

Azure Subscription Migration to a Different Tenant

Utilized PowerShell to create a framework and suite of tools for migrating multiple Azure subscriptions to a new Azure Active Directory tenant. 这包括为新租户中的映射身份重新分配权限. 迁移顺利完成，没有提交任何支持票据.
1987 - 1992

Bachelor's Degree in Aerospace Engineering

美国科罗拉多州博尔德市科罗拉多大学

APRIL 2024 - PRESENT

Databricks Lakehouse Fundamentals

Databricks Academy

JULY 2022 - PRESENT

Microsoft Certified: Azure Data Fundamentals

Microsoft

AUGUST 2019 - PRESENT

Microsoft Certified: Azure Fundamentals

Microsoft

DECEMBER 2006 - DECEMBER 2016

微软认证技术专家:SQL Server 2005

Microsoft

Libraries/APIs

PySpark, REST APIs, Azure Blob Storage API

Tools

SQL Server BI, Synapse, Microsoft Visual c++， Lotus Notes, Microsoft Power BI, GIS

Frameworks

Windows PowerShell, Spark, Data Lakehouse

Paradigms

Database Design, Database Development, ETL, Business Intelligence (BI), Automation, DevOps

Languages

SQL, T-SQL (Transact-SQL), Python, C#.. NET, Visual Basic 6 (VB6)， c++， HTML, Perl, Visual Basic, Python 3

Platforms

Azure, Azure Synapse, Databricks, Amazon Web Services (AWS), Oracle, Docker, Visual Studio Code (VS Code)

Storage

Azure SQL, SQL Server DBA, SQL Server 2005, SQL Server 2008, SQL Server Integration Services (SSIS), SQL Server 2000, SQL Server 2017, Database Modeling, Microsoft SQL Server, Database Replication, Database Architecture, Data Lakes, Data Pipelines, Database Administration (DBA), Database Migration, Databases, SQL Server Reporting Services (SSRS), Azure Cosmos DB, SQL Server 2010, SQL Server 2012, SQL Server 2014, SQL Server Analysis Services (SSAS), Sybase, IBM Informix, MySQL, PostgreSQL

Industry Expertise

Retail & Wholesale

Other

Data Engineering, Data Warehousing, Data Architecture, Data Modeling, Data Migration, Cloud, Microsoft Azure, Data Warehouse Design, ETL Development, Pipelines, Data Analysis, Data Analytics, Data Processing, English, Query Optimization, CSV Export, Advisory, Consulting, Large-scale Projects, Data, Azure Data Lake, Azure Data Factory, Delta Lake, Unstructured Data Analysis, Cloud Migration, Data Strategy, ETL Tools, APIs, Big Data, Data Visualization, Azure Databricks, Engineering, Oracle8i, Unix Shell Scripting, Dynamics CRM 365

Collaboration That Works

How to Work with Toptal

Toptal matches you directly with global industry experts from our network in hours—not weeks or months.

1

Share your needs

在与Toptal领域专家的电话中讨论您的需求并细化您的范围.
2

Choose your talent

Get a short list of expertly matched talent within 24 hours to review, interview, and choose from.
3

Start your risk-free talent trial

与你选择的人才一起工作，试用最多两周. Pay only if you decide to hire them.

Top talent is in high demand.

Start hiring