Pyspark on Frank Kovacshttps://kdataworks.online/technology/pyspark/Recent content in Pyspark on Frank KovacsHugoen© 2025 Francis R. KovacsMon, 02 Feb 2026 00:00:00 +0800Senior Software Engineerhttps://kdataworks.online/experience/disney_senior_swe/Mon, 02 Feb 2026 00:00:00 +0800https://kdataworks.online/experience/disney_senior_swe/As a senior software engineer at Disney I will be building the next generation of streaming infrastructure.Custom Scala ETL Frameworkhttps://kdataworks.online/projects/scala_etl/Fri, 01 Nov 2024 00:00:00 +0800https://kdataworks.online/projects/scala_etl/I implemented a custom ETL framework for use within a databricks execution engine for media data.Inventory Analysishttps://kdataworks.online/projects/inventory_optimization/Fri, 01 Nov 2024 00:00:00 +0800https://kdataworks.online/projects/inventory_optimization/I created and implemented an end-to-end inventory analysis tool to quantify ordering irregularitiesRetail Fraud Detectionhttps://kdataworks.online/projects/retail_fraud_detection/Fri, 01 Nov 2024 00:00:00 +0800https://kdataworks.online/projects/retail_fraud_detection/I created and implemented a machine learning model to identify anomalous employee transactions.Senior Data Engineerhttps://kdataworks.online/experience/senior_data_engineer/Fri, 01 Nov 2024 00:00:00 +0800https://kdataworks.online/experience/senior_data_engineer/As a senior data engineer at Axis I continued to expand my responsibilities and contributions to both Axis and clients.Data Engineerhttps://kdataworks.online/experience/data_engineer/Fri, 30 Dec 2022 10:30:48 +0800https://kdataworks.online/experience/data_engineer/I took the next step of my career as a data engineer at Axis group. This promotion required additional responsibilities, technologies and adjustmentsAnomaly Detection ETLhttps://kdataworks.online/projects/telecommunications_view/Tue, 01 Mar 2022 00:00:00 +0800https://kdataworks.online/projects/telecommunications_view/I worked to implement data views as part of a databricks engagement to feed front end tables.Associate Data Engineerhttps://kdataworks.online/experience/associate_data_engineer/Thu, 21 Oct 2021 10:30:48 +0800https://kdataworks.online/experience/associate_data_engineer/I began my post-school career as an associate data engineer at Axis Group in Berkeley Heights, New JerseyDatabricks Investigationhttps://kdataworks.online/projects/databricks_ingestigation/Thu, 21 Oct 2021 10:30:48 +0800https://kdataworks.online/projects/databricks_ingestigation/I was tasked with creating initial documentation, recommendations and best practices for future engagements with Databricks.