Building Machine Learning Systems with Python - Richert, Coelho
Building Machine Learning Systems with Python - Richert, Coelho
Building Machine Learning Systems with Python - Richert, Coelho
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
Chapter 12<br />
There are three modes of use: a reserved mode, whereby you prepay to have<br />
cheaper per-hour access; a fixed per-hour rate; and a variable rate which depends<br />
on the overall compute market (when there is less demand, the costs are lower;<br />
when there is more demand, the prices go up).<br />
For testing, you can use a single machine in the free tier. This allows you to play<br />
around <strong>with</strong> the system, get used to the interface, and so on. However, this is a<br />
very slow CPU machine. Thus, doing heavy computation using it is not advised.<br />
On top of this general system, there are several types of machines available <strong>with</strong><br />
varying costs; from a single core to a multicore system <strong>with</strong> a lot of RAM, or even<br />
graphical processing units (GPUs). We will later see that you can also get several<br />
of the cheaper machines and build yourself a virtual cluster. You can also choose to<br />
get a Linux or Windows server, <strong>with</strong> Linux being slightly cheaper. In this chapter,<br />
we will work our examples on Linux but most of this information would be valid<br />
for Windows machines as well.<br />
The resources can be managed through a web interface. However, it is also possible<br />
to do so programmatically and by setting up scripts which allocate virtual machines,<br />
setting up disks, and all the operations that are possible through the web interface.<br />
In fact, while the web interface changes very frequently (and some of the screenshots<br />
that we show in the book may be out-of-date by the time it goes to the press), the<br />
programmatic interface is more stable and the general architecture has remained<br />
stable since the service was introduced.<br />
Access to AWS services is performed through a traditional username/password<br />
system, although Amazon calls the username an access key and the password a secret<br />
key. They probably do so to keep it separate from the username/password you use<br />
to access the web interface. In fact, you can create as many access/secret key pairs<br />
as you wish and give them different permissions. This is helpful for a larger team<br />
where a senior user <strong>with</strong> access to the full web panel can create other keys<br />
for developers <strong>with</strong> less privileges.<br />
Amazon regions<br />
Amazon.com has several regions. These correspond to physical regions<br />
of the world: West Coast U.S., East Coast US, several Asian locations,<br />
a South American one, and a European one. If you will be transferring<br />
data, it is best to keep it close to where you will be transferring to and<br />
from. Additionally, if you are handling user information, there may be<br />
regulatory issues if you transfer it to another jurisdiction. In that case, do<br />
check <strong>with</strong> an informed counsel on what the implications of transferring<br />
data about European customers to the US or vice versa are.<br />
[ 249 ]