I'm Simon and I am passionate about data, the new oil.
As a DevOps & Software Engineer I dedicated the last years to BigData and scaling challenges. I combine a deep understanding of Linux systems with a decade of experience in software engineering. Data mining, data processing, data indexing and databases as well as building high performance services are my favorite fields.
Computer Science Expert
2004 - 2007
Fachinformatiker Systemintegration, HHEK Bonn
1995 - 2003
Gesamtschule, Europaschule Bornheim
1990 - 1995
Grundschule, Wendelinus-Grundschule Sechtem
High Performance Time Series Database for IPv4/v6 Blacklistings PyPy SophiaDB
API driven database to historical store billions of IP blacklistings across several blacklist providers through a multi dimensional key design for highly effective range queries to provide an aggregated blacklist service for network operators.Requirements
- Store billions of entries
- Filterable by IP, CIDR, time, time range and blacklist provider
- Result response in under 50 msec.
Tool for statistical analysis based on network related attacks with data coming from Spam trap and Honeypot networks.Requirements
- Store at least 1 year of data with a daily amount of 400 million new entries
- Near real-time data intake
- Filterable by Date, Src. IP, Dst. IP, Src. Port, Dst. Port, Service, Protocol, Country Code, Payload, Attack Type
- Visualize in a customizable dashboard
High Performance & Self-contained Network Service Honyepot Python gevent
Honeypot to record network based attacks on well known services like databases, remote shells, HTTP servers etc. reported near real-time to a centralized data sink.Requirements
- Low memory footprint
- Easy deployment
- Security measure to avoid leak of honeypot node
- Emulate TCP/UDP services
- Automatic updates and control features
- Secure and near real-time event data transport
Pipeline oriented event processing framework Python Redis
Framework to build pipeline oriented work flows for data event processing through isolated pluggable components.
Search Engine Monitoring System Python Pyramid MySQL
Position monitoring of URLs in search engine result pages for given keywords acquired by keyword analysis of competitors and search engine suggestions. Tool was used to measure SEO activities.
Online Game Transaction Tracking System Python CEP
System to track and identify bot activities by gold farmers by tracking ingame transaction events.
User Account Load Balancing System Perl
System for web games to evenly distribute new users across instances.
Server Infrastructure & Role Management Tool Perl MySQL
System to manage thousands of server instances and the application level role of the server to provision and deploy services.
SSH Key Deployment & Privilege Management Tool Perl MySQL
System to manage SSH keys, access to servers and SSH key deployment.
ciso8601 vs mxDateTime vs udatetime
In my last performance comparison I compared libraries with non performance goals with datetime and udatetime, to illustrate the impact of your library choice. Arrow, Pendulum and Delorean are awesome choices when it comes to...format_align_left Read Article
datetime vs Arrow vs Pendulum vs Delorean vs udatetime
The big alternatives to Python datetime all share similar goals. These goals are ease of use, simplicity and intelligent/user friendly API design. Awesome goals and I love those libraries for investing a lot of effort...format_align_left Read Article
udatetime now with ultra fast PyPy support
I just finished the performance optimized pure Python implementation of my RFC3339 date-time library udatetime for PyPy and Python 3.5. The benchmark say PyPy is now officially the fastest with udatetime. Again it’s astonishing how...format_align_left Read Article
udatetime a fast RFC3339 compliant date-time Python library
Working with date-time formats can be pretty upsetting because of the variate of different formats people can come up with. date-times are used everywhere not just only logging or meta data in database entries and...format_align_left Read Article
Fix Ubuntu 16.04, external monitor flickering and turning off on Intel i915.
If you experience constant screen flickering and your external monitor turning off every other 3-5 seconds on a Intel i915, here is how I fixed the issue. Update kernel First get and install the current...format_align_left Read Article
Python TCP socket performance tweak on Linux
TLDR sockopt TCP_NODELAY=1 increases performance big time if you’re doing lots of small blocks of data with socket.IPPROTO_TCP. Long Story Over at abusix I started a project using IMAP. For connecting an IMAP server in...format_align_left Read Article