Contribute Media
A thank you to everyone who has made this possible: Read More

Keynote: Solid data structures in Python with logs

Description

PyCon Finland 2015 Keynote: Jyrki Pulliainen - Solid data structures in Python with logs

We all know the classic web application that has a database connected to it. Over time the app grows and we add more bells and whistles, like a search functionality via ElasticSearch. Soon we notice that we need a cache too.

Now we have a fairly complex application and a completely new set of problems like the cache invalidation, stale data, consistency issues etc.

What if I said that using logs would help you here? This talk looks into using Kafka via Python to build solid data structures.

Overview of the talk outline is:

  • Description of the problem
  • What are log based data structures
  • What's Kafka and why is it amazing?
  • Using Kafka via Python
  • Demo time!

About the author: I'm a content engineer at the music streaming company Spotify. I've been using Python for professional and personal projects for over 10 years now. Over the course of years I've built open-source tools for Python and even contributed to the cpython itself.

I have also been a part of creating both PyCon Finland and PyCon Sweden. I'm also organising the PySthlm meetups in Stockholm.

Details

Improve this page