c# - Run my own application on hadoop without coding mapreduce? -

-

maybe did not understand how complex hadoop is, if there incorrect please me out. got this:

hadoop great thing handle big amount of data. data analysis , mining. can write own mapreduce functions or using pig or hive. can use existing functions, wordcount , stuff - dont have write code.

ok, if use great power of hadoop non-analysis/mining things? example have .net application written in c# able read files , generating pdfs barcodes. application running on 1 server, because 1 server cannot handle big amount of files need more power. why not adding hadoop nodes/clusters handle job?

question: can take .net application , tell hadoop "do this, on every on nodes/cluster"? -> running these jobs without coding, possible?

if not, have throw away .net application , rewrite in pig/hive/java-mapreduce? or how people solve these issues in situation?

ps: important thing here not pdf generator , maybe not .net/c# - question is: there application in language whatever - can give hadoop that? or have rewrite in mapreduce functions?

@mongo : i'm not sure if understood correct i'd try sharing know. first of hadoop framework - not extension or plugin.

if want process files or perform task in hadoop, need make sure requirements put forward hadoop understand data. put simple, let consider same word count example. if want perform word count on file, can using language. lets have done in java, , want scale larger files- dumping same code in hadoop cluster not helpful. though java logic remains same, have write map reduce code in java understood hadoop framework.

here's example of c# map reduce program hadoop processing here's example of mapreduce without hadoop using asp.net pipeline

hope helpful. i'm assuming post adds value question. i'm sure getting better thoughts/suggestions/answers wonderful people here...

p.s: , thats related file processing/ data analysis in hadoop. depends on how :)

cheers !


Comments

Post a Comment

Popular posts from this blog

javascript - Chart.js (Radar Chart) different scaleLineColor for each scaleLine -

-
Image
i try , create radar chart using chart.js has various colours each scaleline, or coloured between scalelines. wondering if possible? from: to: i have working graph, though there doesn't seem method change individual scale lines. kind regards leigh you can extend radar chart type this, so chart.types.radar.extend({ name: "radaralt", initialize: function (data) { chart.types.radar.prototype.initialize.apply(this, arguments); var originalscaledraw = this.scale.draw; var ctx = this.chart.ctx; this.scale.draw = function () { var linewidth = this.linewidth; // bypasses line drawing in originalscaledraw this.linewidth = linewidth; originalscaledraw.apply(this, arguments); ctx.linewidth = this.linewidth; var scale = this; // draw chart.helpers.each(scale.ylabels, function (label, index) { // color of ...
Read more

apache - Error with PHP mail(): Multiple or malformed newlines found in additional_header -

-
suddenly have started receiving above error without changes having been made script. host 1and1 (i know...) the script still works fine on different server, , suspicion there must have been server config change has lead this, although hosts plead ignorance. there's no information on above error @ in google can find - have ideas? server running apache if helps. had similar problem. came out of blue. no php code changed. what changed: php upgraded 5.5.25-1 5.5.26. a security risk in php mail() function has been fixed , newlines in additional_headers allowed no more. because newlines mean: starts email message (and surely don't want inject newlines through headers followed evil message). what have worked fine, e.g. having newlines after headers or passing whole message additional_headers , function no more. solution : sanitize headers. no multiple newlines in additional_headers argument. these count "multiple or malformed newlines":...
Read more

java - Android – MapFragment overlay button shadow, just like MyLocation button -

-
Image
i'm struggling add shadow custom overlay button on google map. goal make custom button google's mylocation button. here's how app looks now: layout.xml <relativelayout xmlns:android="http://schemas.android.com/apk/res/android" xmlns:tools="http://schemas.android.com/tools" xmlns:map="http://schemas.android.com/apk/res-auto" android:layout_height="match_parent" android:layout_width="match_parent" style="@style/apptheme"> <fragment android:layout_width="match_parent" android:layout_height="match_parent" android:id="@+id/map" tools:context=".mapsactivity" android:name="com.google.android.gms.maps.supportmapfragment" android:layout_alignparentend="true" android:layout_alignparentstart="true" android:layout_alignparentbottom="true" ...
Read more