Amazon EMR ã§ã¯ã管çããã Hadoop ãã¬ãŒã ã¯ãŒã¯ãæäŸãããåçã«ã¹ã±ãŒãªã³ã°å¯èœãª Amazon EC2 ã€ã³ã¹ã¿ã³ã¹ã§å€§éã®ããŒã¿ããç°¡åãé«éãé«ã³ã¹ãå¹çãªæ¹æ³ã§åŠçã§ããŸãããŸããApache Spark ã HBaseãPrestoãFlink ãšãã£ãä»ã®äžè¬çãªãã¬ãŒã ã¯ãŒã¯ã Amazon EMR ã§å®è¡ããããšããAmazon S3 ã Amazon DynamoDB ãšãã£ãä»ã® AWS ããŒã¿ã¹ãã¢å ã§ããŒã¿ãæäœããããšãã§ããŸãã
Amazon EMR ã¯ããã°ã®åæããŠã§ãã€ã³ããã¯ã¹ãããŒã¿å€æ (ETL)ãæ©æ¢°åŠç¿ã財ååæãç§åŠã·ãã¥ã¬ãŒã·ã§ã³ãçç©æ å ±ç§åŠç ç©¶ãå«ããããŸããŸãªããã°ããŒã¿ã確å®ãã€å®å šã«åŠçããŸãã
Amazon EMR ã®ããŒãžã§ãã³ã°ãªãªãŒã¹ã«ãããEMR cluster ã§ Apache Hadoop ããã³ Spark ãšã³ã·ã¹ãã ã®ã¢ããªã±ãŒã·ã§ã³ãå«ãææ°ã®ãªãŒãã³ãœãŒã¹ãããžã§ã¯ããç°¡åã«éžæããŠäœ¿çšã§ããŸãããœãããŠã§ã¢ã®ã€ã³ã¹ããŒã«ãšèšå®ã¯ Amazon EMR ã«ãã£ãŠè¡ããããããã€ã³ãã©ã¹ãã©ã¯ãã£ã管çã¿ã¹ã¯ãæ°ã«ããã«ãããŒã¿ã®äŸ¡å€ãé«ããããšã«ããå€ãã®æéããããããšãã§ããŸãã

䜿çšãç°¡å
Amazon EMR ã¯ã©ã¹ã¿ãŒã¯æ°åã§èµ·åã§ããŸããããŒãã®ããããžã§ãã³ã°ãã¯ã©ã¹ã¿ãŒã®ã»ããã¢ãããHadoop ã®èšå®ãã¯ã©ã¹ã¿ãŒã®ãã¥ãŒãã³ã°ãªã©ãããããããäœæ¥ã¯äžèŠã§ãããã®ãããªäœæ¥ã¯ Amazon EMR åŽã§å®è¡ããããããã客æ§ã¯åæã«å°å¿µã§ããŸãã

äœã³ã¹ã
Amazon EMR ã®æéäœç³»ã¯äºæ³ãããããã·ã³ãã«: 䜿çšããã€ã³ã¹ã¿ã³ã¹ã®æéããšã« 1 æéåäœã§æéãæ¯æããŸãã10 ããŒãã® Hadoop ã¯ã©ã¹ã¿ãŒã®éçšãããã 0.15 USD/æéã§éå§ã§ããŸããAmazon EMR 㯠Amazon EC2 ã®ã¹ãããã€ã³ã¹ã¿ã³ã¹ãšãªã¶ãŒããã€ã³ã¹ã¿ã³ã¹ããã€ãã£ããµããŒãããŠãããããåºç€ãšãªãã€ã³ã¹ã¿ã³ã¹ã®ã³ã¹ãã 50ïœ-80% ç¯çŽããããšãã§ããŸãã

䌞瞮èªåšæ§
Amazon EMR ã¯ãã³ã³ãã¥ãŒãã£ã³ã°ã€ã³ã¹ã¿ã³ã¹ã 1 ã€ã§ãæ°çŸãæ°åã§ãããããžã§ãã³ã°ã§ãããããããããèŠæš¡ã®ããŒã¿åŠçã«å¯Ÿå¿ããŸããã€ã³ã¹ã¿ã³ã¹æ°ã¯ç°¡åã«æåã§ããŸã㯠Auto Scaling ã§å¢æžã§ãããæ¯æãã¯äœ¿ã£ãåã®ã¿ã®åŸéæéå¶ã§ãã

ä¿¡é Œæ§
ã¯ã©ã¹ã¿ãŒã®èª¿æŽãã¢ãã¿ãªã³ã°ã«ãããåŽåãåæžã§ããŸããAmazon EMR ã«ã¯ã¯ã©ãŠãçšã®èª¿æŽããã Hadoop ããããã¯ã©ã¹ã¿ãŒãã¢ãã¿ãªã³ã°ããŠå€±æããã¿ã¹ã¯ãå詊è¡ããèªåçã«ããã©ãŒãã³ã¹ã®äœãã€ã³ã¹ã¿ã³ã¹ã眮ãæããŸãã

å®å
š
Amazon EMR 㯠Amazon EC2 ã€ã³ã¹ã¿ã³ã¹ãžã®ãããã¯ãŒã¯ã¢ã¯ã»ã¹ãå¶åŸ¡ãããã¡ã€ã¢ãŠã©ãŒã«ã®åçš®èšå®ãèªåçã«æ§æããŸãããŸããã客æ§ãå®çŸ©ããè«ççã«éé¢ããããããã¯ãŒã¯ã§ãã Amazon Virtual Private Cloud (VPC) å
ã«ã¯ã©ã¹ã¿ãŒãèµ·åããããšãã§ããŸããAmazon S3 ã«ä¿åããããªããžã§ã¯ãã®å ŽåãAWS Key Management Service ãŸãã¯ã«ã¹ã¿ããŒç®¡çåã®ããŒã䜿çšã㊠Amazon S3 ãµãŒããŒåŽã®æå·åãŸã㯠Amazon S3 ã¯ã©ã€ã¢ã³ãåŽã®æå·åãš EMRFS ã䜿çšã§ããŸãã

æè»æ§
ã客æ§ãã¯ã©ã¹ã¿ãŒã®ãã¹ãŠãå¶åŸ¡ããããšãã§ããŸãããŸããåã€ã³ã¹ã¿ã³ã¹ãžã®ã«ãŒãã¢ã¯ã»ã¹æš©éãæã€ãããç°¡åã«ãã®ä»ã®ã¢ããªã±ãŒã·ã§ã³ã远å ããããŒãã¹ãã©ããã¢ã¯ã·ã§ã³ã䜿çšããŠãã¯ã©ã¹ã¿ãŒããšã«èšå®ãã«ã¹ã¿ãã€ãºã§ããŸããã«ã¹ã¿ã Amazon Linux AMI ã䜿çšããŠãAmazon EMR ã¯ã©ã¹ã¿ãŒãèµ·åããããšãã§ããŸãã

ã¯ãªãã¯ã¹ããªãŒã åæ
Amazon EMR ã䜿çšãããšãã¯ãªãã¯ã¹ããªãŒã ããŒã¿ãåæããŠãŠãŒã¶ãŒãåºåãããŠãŒã¶ãŒã®å¥œã¿ãææ¡ããŠããã广çãªåºåãé
ä¿¡ã§ããŸãã
Razorfish ã«ãã EMR ã䜿ã£ãã¯ãªãã¯ã¹ããªãŒã ã®åæäºäŸã®è©³çް »

ãªã¢ã«ã¿ã€ã åæ
Amazon KinesisãApache Kafka ãŸãã¯ãã®ä»ã®ããŒã¿ã¹ããªãŒã ããã®ãªã¢ã«ã¿ã€ã ããŒã¿ããAmazon EMR ã§ Spark Streaming ã䜿çšããŠåã蟌ã¿ãåŠçããŸããã¹ããªãŒãã³ã°åæãèé害æ§ã®ããæ¹æ³ã§å®è¡ããçµæã Amazon S3 ã HDFS ã«æžã蟌ã¿ãŸãã
Hearst ã«ãã Spark Streaming ã®äœ¿ç𿹿³ »

ãã°åæ
Amazon EMR ã¯ãŠã§ããã¢ãã€ã«ã¢ããªã±ãŒã·ã§ã³ã§çæããããã°ã®åŠçã«ã䜿çšã§ããŸããAmazon EMR ã¯ããã¿ãã€ãçŽã®éæ§é åããŒã¿ãåæ§é åããŒã¿ããã¢ããªã±ãŒã·ã§ã³ããŠãŒã¶ãŒã«é¢ããæçãªã€ã³ãµã€ããåŸãã®ã«åœ¹ç«ã¡ãŸãã
Yelp ã EMR ã䜿çšããŠäž»ãªãŠã§ããµã€ãæ©èœãæšé²ããæ¹æ³ »

æœåºã倿ãèªã¿èŸŒã¿ (ETL)
Amazon EMR ã䜿çšãããšãäžŠã¹æ¿ããéèšãçµåãªã©ã®ããŒã¿å€æã¯ãŒã¯ããŒã (ETL) ãå€§èŠæš¡ãªããŒã¿ã»ããã§ãã°ããã³ã¹ãå¹çããå®è¡ã§ããŸãã
Redfin ã«ãã ETL çšã®äžæç㪠EMR ã¯ã©ã¹ã¿ãŒã®äœ¿ç𿹿³ »

äºæž¬åæ
Amazon EMR ã§ã® Apache Spark ã«ã¯ãã¹ã±ãŒã©ãã«ãªæ©æ¢°åŠç¿ã¢ã«ãŽãªãºã ã«å¯Ÿå¿ãã MLlib ãå«ãŸããŠããŸããç¬èªã®ã©ã€ãã©ãªã䜿çšããããšãå¯èœã§ããSpark ã§ã¯ãããŒã¿ã»ãããã¡ã¢ãªå
ã«ä¿åãããšãäžè¬çãªæ©æ¢°åŠç¿ã¯ãŒã¯ããŒãã®ããã©ãŒãã³ã¹ãåäžããŸãã
Intent Media ã«ãã Spark MLib ã®äœ¿ç𿹿³ »

ã²ããã¯ã¹
Amazon EMR ã§ã¯ãèšå€§ãªéã®ã²ããã¯ã¹ããŒã¿ãããã®ä»ã®å€§éã®ç§åŠããŒã¿ã»ããããã°ããå¹ççã«åŠçããããšãã§ããŸããç ç©¶è
㯠AWS ã§ç¡æã§ãã¹ããããŠããã²ããã¯ã¹ããŒã¿ã«ã¢ã¯ã»ã¹ã§ããŸãã
Apache Spark ãšåå¥åå»çã®è©³çް »
Amazon EMR ã¯ç°¡åã«äœ¿çšãéå§ã§ããŸãããã¡ãŒã¹ã ã¹ããã ã¬ã€ãã«åŸã£ãŠãæ°åã¯ãªãã¯ããã ãã§æåã® Amazon EMR ã¯ã©ã¹ã¿ãŒãèµ·åããããŒã¿ã®åæãéå§ã§ããŸãã














