elasticsearch - Log shipping from tomcat cluster -

-

i'm investigating issue logging system , looking input on possible solutions problem. have now:

  • cluster of 6 tomcats, logging (log4j2) configured use socketappender
  • the listener these logstash agent puts logged events on redis
  • another logstash agent picks entries redis , pushes them elasticsearch

the problem have @ times client sockets (log4j loggers) wait indefinitely causing application become unresponsive. 1 of suggested solutions away socket appenders , use local file (we don't need "instant" log info in kibana). logstash agent configured read 6 files (one per instance) , push these straight elastic search. can suggest disadvantages of approach other having 6 files defined in input configuration of logstash? other options can suggest? in advance.

i not use socketappender if have choice so. 1 issue being 1 mentioned , 1 if on logstash 1.5x or before, find more troublesome, exact timestamp of event (as created log4j2) not conveyed, means timestamp of log line arrival time of log line in logstash instead of time @ log line created application. if you're aggregating logs different apps/servers/subsystems in stack, hassle make sense of temporality of events. fixed in logstash 2.0, though, still worth mentioning.

aside that, there @ least 3 reasons storing logs file on filesystem instead of shipping them directly via tcp:

  1. your log files act de facto backup of log events, i.e. can replay files anytime wish
  2. your application doesn't depend on synchronous sub-system sending log lines, sinks them on own file system
  3. your logstash can down (upgrade, network connectivity, etc) , app still able produce logs, no matter what's going on down chain.

Comments

Post a Comment

Popular posts from this blog

javascript - Chart.js (Radar Chart) different scaleLineColor for each scaleLine -

-
Image
i try , create radar chart using chart.js has various colours each scaleline, or coloured between scalelines. wondering if possible? from: to: i have working graph, though there doesn't seem method change individual scale lines. kind regards leigh you can extend radar chart type this, so chart.types.radar.extend({ name: "radaralt", initialize: function (data) { chart.types.radar.prototype.initialize.apply(this, arguments); var originalscaledraw = this.scale.draw; var ctx = this.chart.ctx; this.scale.draw = function () { var linewidth = this.linewidth; // bypasses line drawing in originalscaledraw this.linewidth = linewidth; originalscaledraw.apply(this, arguments); ctx.linewidth = this.linewidth; var scale = this; // draw chart.helpers.each(scale.ylabels, function (label, index) { // color of ...
Read more

apache - Error with PHP mail(): Multiple or malformed newlines found in additional_header -

-
suddenly have started receiving above error without changes having been made script. host 1and1 (i know...) the script still works fine on different server, , suspicion there must have been server config change has lead this, although hosts plead ignorance. there's no information on above error @ in google can find - have ideas? server running apache if helps. had similar problem. came out of blue. no php code changed. what changed: php upgraded 5.5.25-1 5.5.26. a security risk in php mail() function has been fixed , newlines in additional_headers allowed no more. because newlines mean: starts email message (and surely don't want inject newlines through headers followed evil message). what have worked fine, e.g. having newlines after headers or passing whole message additional_headers , function no more. solution : sanitize headers. no multiple newlines in additional_headers argument. these count "multiple or malformed newlines":...
Read more

java - Android – MapFragment overlay button shadow, just like MyLocation button -

-
Image
i'm struggling add shadow custom overlay button on google map. goal make custom button google's mylocation button. here's how app looks now: layout.xml <relativelayout xmlns:android="http://schemas.android.com/apk/res/android" xmlns:tools="http://schemas.android.com/tools" xmlns:map="http://schemas.android.com/apk/res-auto" android:layout_height="match_parent" android:layout_width="match_parent" style="@style/apptheme"> <fragment android:layout_width="match_parent" android:layout_height="match_parent" android:id="@+id/map" tools:context=".mapsactivity" android:name="com.google.android.gms.maps.supportmapfragment" android:layout_alignparentend="true" android:layout_alignparentstart="true" android:layout_alignparentbottom="true" ...
Read more