Migrating Uber from MySQL to PostgreSQL

Recommendations

Info

The Actual Migration The Second Attempt We made the second conversion attempt about two weeks after the initial attempt... to great success! In the end, the conversion took something like 90 minutes plus additional time for read-only mode testing, about twice as long as when I started the project three months earlier (due to the growth of some large tables). Evan Klitzke (Uber, Inc.) Migrating Uber from MySQL to PostgreSQL March 13, 2013 58 / 59
The Actual Migration xml2pgcopy, redux We plan to release code for xml2pgcopy, the C++ program I wrote to convert mysqldump --format=xml output to Postgres COPY format today. This tool worked for Uber’s dataset, but likely needs modification if you’re using extensively different data types, or MySQL features that we didn’t use. It should be a good jumping off point, though. Evan Klitzke (Uber, Inc.) Migrating Uber from MySQL to PostgreSQL March 13, 2013 59 / 59
Page 1 and 2:
Migrating Uber from MySQL to Postgr
Page 3 and 4:
Background Background Uber is a mob
Page 5 and 6:
The Objective Background The object
Page 7 and 8: Obstacles cont. Background Addition
Page 9 and 10: Plan of Attack Background To do a m
Page 11 and 12: Background “Replication” Plan,
Page 13 and 14: Background Serialization Problem Th
Page 15 and 16: Conversion Background OK, how much
Page 17 and 18: Conversion Background It turns out
Page 19 and 20: Background MySQLisms (quoting) Quot
Page 21 and 22: Attempt 1 Background My first attem
Page 23 and 24: XML Attempt Background Next I disco
Page 25 and 26: XML Attempt Background New plan of
Page 27 and 28: XML Attempt Background Initial test
Page 29 and 30: XML Attempt Background It turns out
Page 31 and 32: xml2pgcopy Background The final imp
Page 33 and 34: Code Changes Code Changes The other
Page 35 and 36: Boolean Errors Code Changes As note
Page 37 and 38: Timezone Issues Code Changes Produc
Page 39 and 40: ENUMs Code Changes In MySQL, ENUMs
Page 41 and 42: Code Changes Implicit Ordering (con
Page 47 and 48: Code Changes GROUP BY (cont.) MySQL
Page 49 and 50: Case Sensitivity Code Changes Case
Page 51 and 52: Code Changes SQLAlchemy autoflush A
Page 53 and 54: The Actual Migration Production Set
Page 55 and 56: First Attempt The Actual Migration
Page 57: Interim The Actual Migration In ret
show all

Migrating Uber from MySQL to PostgreSQL

You also want an ePaper? Increase the reach of your titles

Delete template?

Save as template?