Archive
Tags
About
Subscribe
Data Dreamer
Data Engineer and Enthusiast
Data Quality Testing for Data Platforms
I’m currently working on a new approach for data-quality testing of a data platform (data warehouse). The whole approach is based on the assumption that you can estimate the probability distribution from quantiles and compare distributions for subsequent loads/days for each attribute (e.g. column in a table). Divide the data of an attribute into buckets of equal size (e.g. ntile function for MSSQL and store the start / end for each bucket Calculate a numeric value for each bucket-start/-end (convert strings to numbers) Create a histogram for both loads to compare (e.
Can I run every Day?
Yesterday I wondered if I’d be able to run every day for a while. So I decided spontaneously: why not try it? I’ll try to run 10km each day this week. Since I started to take running serious I trained about 4 times/week resulting in 30 to 45km per week. Once in a while I had 3 runs in a row when I moved the training sessions around my schedule.
Crypto FOMO
In recent weeks I saw a lot of crypto FOMO. Again. It seems everybody is starting to talk about Bitcoin and other cryptocurrencies as soon as prices start to increase - similar as it was back in 2018 when everybody (read: “normal people” aka non-tech-enthusiasts aka everybody) was talking about Bitcoin. I’m curious where the price will lead - if it will take a huge hit and go back to <10k or if it will raise to 100k as some people predict.
How I Reached 100k 💶
As I mentioned a few days ago one of my goals until I get 30 years old was to reach € 100k net worth. 5 years ago I read a lot (huge shout out to all the experts in the German Wertpapier Community) and decided I will go the unamusing but proven route of a “classic world portfolio”: 70% MSCI World and 30% Emerging Markets. I tried to stick with my initial defined strategy through all the years and therefore my way to 100k was rather boring as you see in the following chart: I had monthly investment plans since I started my journey and once per year did a bit of rebalancing when I received my yearly bonus.
From 0 to 1750 🏃
I started taking running serious In 2020 I ran over 1 750km! I can’t quite believe it myself as I was barely running before, but my tracked data proves it! How I started to run in 2020 Beginning of 2020 my best friend asked me if we should try to run the half-marathon in our city. I was doubtful of the challenge and decided to make a test run with ~10km and a suuuuper slow pace.
My Goals until I get 30
My goals until I get 30 years old Back in June 2015 I had one year left before finishing my studies and I thought about what I want to achieve until I’m 30. To make it a bit more convenient (and get a bit more time) I specified that I want to achieve my goals until the end of the year when I’ll turn 30. As goals always should be SMART the easiest way for me was to focus on tangible numbers.
Success Factors for Self-Service BI
What is self-service business intelligence? As it’s quite late I’ll make it easy for me and just cite the definition of one of the big players in the self-service BI space: Self-service business intelligence (SSBI) empowers teams such as product developers, sales, finance, marketing, operations, and more to answer data questions, with governance supported by IT and business intelligence (BI) analysts. BI is the strategic process of using data insights to make decisions that help organizations reach their goals.
Welcome to my Blog
Welcome to data-dreamer.com! Welcome to my first post at my newly created blog. Why is it called data-dreamer? I like to describe myself as a “Data Enthusiast”. I planned to get a .com-domain. data-enthusiast.com was not available anymore (and would also be a bit hard to spell) so I translated Enthusiast back and forth (from German to English) and came up with Dreamer. Why this blog? I had the idea to start a blog a while ago.
←
Newer Posts