Andrew Rowe

Number of videos:
Big Data Deduplication and data matching using Python
PyCon AU 2013
Andrew Rowe
Recorded: July 7, 2013Language: English

Andrew Rowe will present the lessons learnt and techniques used to process very large amounts of data from the ABS Census. The Australian Bureau of Statistics used Python to investigate data from the 2006 Australian Census. Python is an integral part of ABS systems to determine duplicated entries and link people in the Census to other ABS collections. You will learn about: Handling large data. Dealing with confidentiality. Multiprocessing techniques. Performance tips and tricks. * Difference between if( 1 < 2 ) and if 1 < 2.

Techniques for improving Python performance
PyCon AU 2012
Andrew Rowe
Recorded: Aug. 22, 2012Language: English

Andrew Rowe will detail and demonstrate a number of proven techniques for improving the performance of large Python programs.