Migrating Uber from MySQL to PostgreSQL

Recommendations

Info

Obstacles Background Minimizing downtime was essential; the real cost of downtime is easily calculable and significant. Migration (work began in October 2012) had to be coordinated around the schedule of our two biggest days: weekend before Halloween, and New Year’s Eve. Evan Klitzke (Uber, Inc.) Migrating Uber from MySQL to PostgreSQL March 13, 2013 6 / 59
Obstacles cont. Background Additionally, at the time the project was conceived, growth was sustained at > 10x per year for the previous two years. Getting the project done expediently was a big concern, since the database was growing at about that rate. Migrating a 500GB database would have been hugely problematic. Evan Klitzke (Uber, Inc.) Migrating Uber from MySQL to PostgreSQL March 13, 2013 7 / 59
Page 1 and 2: Migrating Uber from MySQL to Postgr
Page 3 and 4: Background Background Uber is a mob
Page 5: The Objective Background The object
Page 9 and 10: Plan of Attack Background To do a m
Page 11 and 12: Background “Replication” Plan,
Page 13 and 14: Background Serialization Problem Th
Page 15 and 16: Conversion Background OK, how much
Page 17 and 18: Conversion Background It turns out
Page 19 and 20: Background MySQLisms (quoting) Quot
Page 21 and 22: Attempt 1 Background My first attem
Page 23 and 24: XML Attempt Background Next I disco
Page 25 and 26: XML Attempt Background New plan of
Page 27 and 28: XML Attempt Background Initial test
Page 29 and 30: XML Attempt Background It turns out
Page 31 and 32: xml2pgcopy Background The final imp
Page 33 and 34: Code Changes Code Changes The other
Page 35 and 36: Boolean Errors Code Changes As note
Page 37 and 38: Timezone Issues Code Changes Produc
Page 39 and 40: ENUMs Code Changes In MySQL, ENUMs
Page 41 and 42: Code Changes Implicit Ordering (con
Page 47 and 48: Code Changes GROUP BY (cont.) MySQL
Page 49 and 50: Case Sensitivity Code Changes Case
Page 51 and 52: Code Changes SQLAlchemy autoflush A
Page 53 and 54: The Actual Migration Production Set
Page 55 and 56: First Attempt The Actual Migration
Page 57 and 58:
Interim The Actual Migration In ret
Page 59:
The Actual Migration xml2pgcopy, re
show all

Migrating Uber from MySQL to PostgreSQL

Create successful ePaper yourself

Delete template?

Save as template?