Technology Evangelist Amazon Web Services jvariaamazon PDF document - DocSlides

Technology Evangelist Amazon Web Services jvariaamazon PDF document - DocSlides

2014-12-11 113K 113 0 0

Description

com Introduction Keywords brPage 2br Why Cloud Architectures Business Benefits of Cloud Architectures FXVWRPHU57526V57347RZQ57347LQIUDVWUXFWXUH57347573553 Examples of Cloud Architectures x x x x x x x x x x x x x WKDW5734757523VOHHS57524 ID: 22247

Embed code:

Download this pdf



DownloadNote - The PPT/PDF document "Technology Evangelist Amazon Web Service..." is the property of its rightful owner. Permission is granted to download and print the materials on this web site for personal, non-commercial use only, and to display it on your personal computer provided you do not modify the materials and that you retain all copyright notices contained in the materials. By downloading content from our website, you accept the terms of this agreement.

Presentations text content in Technology Evangelist Amazon Web Services jvariaamazon


Page 1
Technology Evangelist Amazon Web Services (jvaria@amazon.com) Introduction Keywords
Page 2
Why Cloud Architectures? Business Benefits of Cloud Architectures FXVWRPHUVRZQLQIUDVWUXFWXUH3& Examples of Cloud Architectures x x x x x x x x x x x x x WKDWVOHHSDWQLJKW x x x VLWHV %ODFN)ULGD\
Page 3
QDPHGDV*UHS7KH:HE Cloud Architecture Example: GrepTheWeb JUHS +H\KHVDLG:K\:DLW "RUVHDUFKLQJIRU PDWKHPDWLFDOHTXDWLRQVI[ [: GLVLQWHJUDWLRQRIOLIH x x x PDFKLQHVGRZQERWWRP7RJHWDUHVSRQVHLQD GrepTheWeb Application RegEx Subset of document URLs that matched the RegEx Input dataset (List of Document Urls) GetStatus
Page 4
x x DVDJOXHEHWZHHQFRQWUROOHUV x x x Work flow Launch Phase Monitor Phase Shutdown Phase Cleanup Phase Amazon SQS Controller Amazon EC2 Cluster Amazon S3 Amazon SimpleDB DB User info, Job status info Launch, Monitor, Shutdown Input Output Manage phases StartGrep RegEx GetStatus Input Files (Alexa Crawl) Get Output
Page 5
Amazon SimpleDB Amazon SQS Controller Amaz on S3 Master M Slaves N HDFS Hadoop Cluster on mazon EC2 Launch Queue Monitor Queue Launch Controller Shutdown Queue Monitor Controller Billing Queue Shutdown Controller Status Output Billing Service Billing Controller aunch ing Shutdown Insert JobID, Status Insert Amazon EC2 info Get EC2 Info Put File Input Get File Check for results
Page 6
The Use of A mazon eb ervices How Was Amazon S3 Used RUPRI$OH[DV:HE&UDZO How Was Amazon SQS Used DVJOXHWKDWZLUHG VSLN\PHVVDJHWUDIILF FRQWUROOHUVIXQFWLRQLVWRUHWULHYHWKHPHVVDJHSURFHVV How Was Amazon SimpleDB Used GDWDWRDMRELWHP)RUH[DPSOH)RUDJLYHQMREUXQ QGRFXPHQWVWKH ODXQFKFRQWUROOHUZLOODGGXSGDWHWKHODXQFKBVWDWXV DWWULEXWHDORQJZLWKWKHODXQFKBVWDUWWLPHZKLOHWKH PRQLWRUFRQWUROOHUZLOODGGXSGDWHWKHPRQLWRUBVWDWXV DQGKDGRRSBVWDWXVDWWULEXWHVZLWKHQXPHUDWLRQYDOXHV How Was Amazon EC2 Used
Page 7
Hadoop Map Reduce DGRRSWKHUHVDPDVWHUSURFHVVUXQQLQJRQRQHQRGH ILQDORXWSXWEDFNWRGLVWULEXWHGILOHV\VWHP Map Map Map Map Reduce Combine Hadoop Job Tasks User1 StartJob1 StopJob1 Service Map Map Map Map Reduce Combine Hadoop Job Tasks User2 StartJob2 StopJob2 Store status and results Get Result Figure : Map Reduce Operation (in GrepTheWeb)
Page 8
GrepTheWeb Hadoop Implementation WRDJJUHJDWHDOOWKHRXWSXWV7KHILQDORXWSXWLVZULWWHQ $]RQ Tips for Designing a Cloud Architecture Application TXHVWLRQ:KDWLIWKLVIDLOV" ODVWNQRZQ 'RQWIRUJHWWKH ,WV Use Scalable Ingredien ts Have Loosely Coupled Systems
Page 9
Think Parallel HUDRIWHUDDQGPXOWL On Demand Requisition and Relinquishment KRVWHGLQ$PD]RQVGDWDFHQWHUVDQGDYDLODEOHRQ Queue Queue Controller Queue Controller Controller Controller Controller Controller Call Method in C from B Call Method in B from A Tight coupling ( rocedural rogramming) Loose coupling ( ndependent phases using queues)
Page 10
Use Designs that Are Resilient to Reboot and Re Launch Results and Costs Conclusion
Page 11
Best Practices from Lessons Learned Best Practices of Amazon S3 Best Practices of Amazon SQS ActionRequestId f474b439 ee32 4af0 8e0f a62d1f7de897 Code Queued Message Your request has been queued. ActionName StartGrep RegEx A(.*)zon InputUrl http://s3.am azonaws.com/com.alexa.msr.prod/msr_ f474b439 ee32 4af0 8e0f a979907de897.dat.gz?Signature=CvD9iHA%3D&Expire s=1204840434&AWSAccessKeyId=DDXCXCCDEEDSDFGSDDX ActionRequestId f474b439 ee32 4af0 8e0f a62d1f7de897 Code Completed Message Results are now availab le for download from DownloadUrl ActionName StartGrep StartDate 2008 03 05T12:33:05 DownloadUrl http://s3.amazonaws.com/com.alexa.gtw.prod/gtw _f474b439 ee32 4af0 8e0f a62de897.dat.gz?Signature=CvD9iIGGjUIlkOlAeHA% 3D&Expires=1204840434&AWSAccessKeyId=DDXCXCCDE EDSDFGSDDX RPWKHIURPTXHXHDQGWKHQ WRTXHXH
Page 12
Best practices of Amazon SimpleDB %DVH&RQWUROOHUFODVVVPDLQUHVSRQVLELOLW\LVWRGHTXHXH WKHPHVVDJHIURPWKHIURP WLPHVWDPSDQGVWDWXVDQGSXWDQHZPHVVDJHLQWKHWR Controller Thread Queue Queue 1. Cont roller dequeues message from Queue A 2. Controller executes Tasks (for eg. Launch, monitor etc) 3. Controller Updates Statuses in status DB 4. Controller enqueues new message in Queue B Execute Tasks GetMessage() PutMessage() Status DB replaceableAttribute() Public Abstract BaseController (SQSMessageQueue fromQueue, SQSMessageQueue toQueue, SDBDom ain domain)
Page 13
Best Practices of Amazon EC2 Credits Further Reading
Page 14
Recommendations x x x

About DocSlides
DocSlides allows users to easily upload and share presentations, PDF documents, and images.Share your documents with the world , watch,share and upload any time you want. How can you benefit from using DocSlides? DocSlides consists documents from individuals and organizations on topics ranging from technology and business to travel, health, and education. Find and search for what interests you, and learn from people and more. You can also download DocSlides to read or reference later.