Continuous high load after upgrading to WowzaStreamingEngine

Wowza Streaming Engine causes continuous high load on the server even when not use, higher than any other services or accounts on server. This still occurs after upgrading to 4.1.0, build 12602, released on September 11, 2014

Did not experience such results with previous versions (Wowza Media Server 2,3…) where process CPU was around 3%.

With the new Wowza version server load averages jumped from 0.5% to 4%.

8281 (Trace) (Kill) root 0 19.7 4.8 java -Xmx2000M -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:NewSize=128m -server -Djava.net.preferIPv4Stack=true -Dcom.sun.management.jmxremote=true -Dcom.wowza.wms.runmode=service -Dcom.wowza.wms.native.base=linux -Dcom.wowza.wms.AppHome=/usr/local/WowzaStreamingEngine -Dcom.wowza.wms.ConfigURL= -Dcom.wowza.wms.ConfigHome=/usr/local/WowzaStreamingEngine -cp /usr/local/WowzaStreamingEngine/bin/wms-bootstrap.jar com.wowza.wms.bootstrap.Bootstrap start

27003 (Trace) (Kill) root 0 2.4 7.9 java -Dcom.wowza.wms.ConfigURL=“” -Dcom.wowza.wms.ConfigHome=/usr/local/WowzaStreamingEngine/manager -Djava.io.tmpdir=/usr/local/WowzaStreamingEngine/manager/temp -Dlog4j.configuration=file:///usr/local/WowzaStreamingEngine/manager/conf/winstone.properties -Djava.net.preferIPv4Stack=true -jar /usr/local/WowzaStreamingEngine/manager/lib/wms-winstone-1.0.5-boot.jar --prefix=/enginemanager --defaultWebApp=/enginemanager --tempDirectory=/usr/local/WowzaStreamingEngine/manager/temp --webroot=/usr/local/WowzaStreamingEngine/manager/temp --warfile=/usr/local/WowzaStreamingEngine/manager/lib/WMSManager.war --httpPort=8088 --ajp13Port=-1 --directoryListings=false > /dev/null

Server monitoring shows only 1-2 connection when checking so this is not caused by high usage.

Current Connections Incoming and outgoing

Total: 1

iotop shows many wowza threads:

TID PRIO USER DISK READ DISK WRITE SWAPIN IO> COMMAND

8849 be/4 root 0.00 B/s 0.00 B/s 0.00 % 81.71 % java -Xmx2000M -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:NewSize=128m -server -Dja~al/WowzaStreamingEngine/bin/wms-bootstrap.jar com.wowza.wms.bootstrap.Bootstrap start

8432 be/4 root 0.00 B/s 0.00 B/s 0.28 % 0.28 % java -Xmx2000M -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:NewSize=128m -server -Dja~al/WowzaStreamingEngine/bin/wms-bootstrap.jar com.wowza.wms.bootstrap.Bootstrap start

8430 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.28 % java -Xmx2000M -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:NewSize=128m -server -Dja~al/WowzaStreamingEngine/bin/wms-bootstrap.jar com.wowza.wms.bootstrap.Bootstrap start

26996 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.09 % bash /usr/bin/WowzaStreamingEngineManagerd /usr/local/WowzaStreamingEngine/manager/bin/setmgrenv.sh /var/run/WowzaStreamingEngineManager.pid start

8851 be/4 root 0.00 B/s 0.00 B/s 81.71 % 0.09 % java -Xmx2000M -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:NewSize=128m -server -Dja~al/WowzaStreamingEngine/bin/wms-bootstrap.jar com.wowza.wms.bootstrap.Bootstrap start

8372 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % java -Xmx2000M -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:NewSize=128m -server -Dja~al/WowzaStreamingEngine/bin/wms-bootstrap.jar com.wowza.wms.bootstrap.Bootstrap start

27236 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % java -Dcom.wowza.wms.ConfigURL=“” -Dcom.wowza.wms.ConfigHome=/usr/local/WowzaStreamin~b/WMSManager.war --httpPort=8088 --ajp13Port=-1 --directoryListings=false > /dev/null

27003 be/4 root 0.00 B/s 0.00 B/s 0.37 % 0.00 % java -Dcom.wowza.wms.ConfigURL=“” -Dcom.wowza.wms.ConfigHome=/usr/local/WowzaStreamin~b/WMSManager.war --httpPort=8088 --ajp13Port=-1 --directoryListings=false > /dev/null

8852 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % java -Xmx2000M -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:NewSize=128m -server -Dja~al/WowzaStreamingEngine/bin/wms-bootstrap.jar com.wowza.wms.bootstrap.Bootstrap start

8431 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % java -Xmx2000M -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:NewSize=128m -server -Dja~al/WowzaStreamingEngine/bin/wms-bootstrap.jar com.wowza.wms.bootstrap.Bootstrap start

8433 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % java -Xmx2000M -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:NewSize=128m -server -Dja~al/WowzaStreamingEngine/bin/wms-bootstrap.jar com.wowza.wms.bootstrap.Bootstrap start

8436 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % java -Xmx2000M -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:NewSize=128m -server -Dja~al/WowzaStreamingEngine/bin/wms-bootstrap.jar com.wowza.wms.bootstrap.Bootstrap start

8373 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % java -Xmx2000M -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:NewSize=128m -server -Dja~al/WowzaStreamingEngine/bin/wms-bootstrap.jar com.wowza.wms.bootstrap.Bootstrap start

8434 be/4 root 0.00 B/s 0.00 B/s 0.28 % 0.00 % java -Xmx2000M -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:NewSize=128m -server -Dja~al/WowzaStreamingEngine/bin/wms-bootstrap.jar com.wowza.wms.bootstrap.Bootstrap start

8435 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % java -Xmx2000M -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:NewSize=128m -server -Dja~al/WowzaStreamingEngine/bin/wms-bootstrap.jar com.wowza.wms.bootstrap.Bootstrap start

8440 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % java -Xmx2000M -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:NewSize=128m -server -Dja~al/WowzaStreamingEngine/bin/wms-bootstrap.jar com.wowza.wms.bootstrap.Bootstrap start

8443 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % java -Xmx2000M -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:NewSize=128m -server -Dja~al/WowzaStreamingEngine/bin/wms-bootstrap.jar com.wowza.wms.bootstrap.Bootstrap start

8850 be/4 root 0.00 B/s 0.00 B/s 0.00 % 0.00 % java -Xmx2000M -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:NewSize=128m -server -Dja~al/WowzaStreamingEngine/bin/wms-bootstrap.jar com.wowza.wms.bootstrap.Bootstrap start

top also shows high usage:

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND

8281 root 19 0 3096m 374m 12m S 34.3 4.7 5:18.51 java

Wowza CPU from Server Monitoring reports average use under 5% but with major spikes including over 50%.

Here’s a process dump: http://videowhispers.com/wowzadump.txt

Could this be related to the high number of ServerHandler (240) ?

Handler Thread Pool Size - Set automatically to: 240 threads

Transport Thread Pool Size - Set automatically to: 160 threads

Any suggestions ?

Tune.xml :

<?xml version="1.0" encoding="UTF-8"?>
<Root>
	<Tune>
		<!-- 
			HeapSize
			${com.wowza.wms.TuningHeapSizeProduction} - Assumes Wowza Streaming Engine is only application running on server
			${com.wowza.wms.TuningHeapSizeDevelopment} - Assumes Wowza Streaming Engine is sharing resources with other applications
			or specify heap size directly (ex: <HeapSize>8000M</HeapSize>)
		-->
		<HeapSize>2000M</HeapSize>
		<!--
			GarbageCollector
			${com.wowza.wms.TuningGarbageCollectorConcurrentDefault} - Concurrent Collector (recommended)
			${com.wowza.wms.TuningGarbageCollectorG1Default} - G1 (Garbage First) Collector
			or specify custom GC settings directly (ex: <GarbageCollector>-XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:NewSize=512m</GarbageCollector>)
		-->
		<GarbageCollector>${com.wowza.wms.TuningGarbageCollectorConcurrentDefault}</GarbageCollector>
		<!-- 
			VM Options - other VM startup options
			${com.wowza.wms.AppHome} - Application home directory
			${com.wowza.wms.StartupDateTime} - Date and time the server was started
		-->
		<VMOptions>
			<VMOption>-server</VMOption>
			<VMOption>-Djava.net.preferIPv4Stack=true</VMOption>
			<!-- <VMOption>-XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath="${com.wowza.wms.AppHome}/logs"</VMOption> -->
			<!-- <VMOption>-Duser.language=en -Duser.country=US -Dfile.encoding=Cp1252</VMOption> -->
			<!-- <VMOption>-verbose:gc -Xloggc:"${com.wowza.wms.AppHome}/logs/gc_${com.wowza.wms.StartupDateTime}.log" -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintHeapAtGC -XX:+PrintGCApplicationConcurrentTime -XX:+PrintGCApplicationStoppedTime</VMOption> -->
		</VMOptions>
	</Tune>
</Root>

vhost.xml :

<?xml version="1.0" encoding="UTF-8"?>
<Root version="2">
	<VHost>
		<Description></Description>
		<HostPortList>
			<HostPort>
				<Name>Default Streaming</Name>
				<Type>Streaming</Type>
				<ProcessorCount>${com.wowza.wms.TuningAuto}</ProcessorCount>
				<IpAddress>*</IpAddress>
				<!-- Separate multiple ports with commas -->
				<!-- 80: HTTP, RTMPT -->
				<!-- 554: RTSP -->
				<Port>1935</Port>
				<HTTPIdent2Response></HTTPIdent2Response>
				<SocketConfiguration>
					<ReuseAddress>true</ReuseAddress>
					<!-- suggested settings for video on demand applications -->
					<ReceiveBufferSize>65000</ReceiveBufferSize>
					<ReadBufferSize>65000</ReadBufferSize>
					<SendBufferSize>65000</SendBufferSize>
					<!-- suggest settings for low latency chat and video recording applications
					<ReceiveBufferSize>32000</ReceiveBufferSize>
					<ReadBufferSize>32000</ReadBufferSize>
					<SendBufferSize>32000</SendBufferSize>
					-->
					<KeepAlive>true</KeepAlive>
					<!-- <TrafficClass>0</TrafficClass> -->
					<!-- <OobInline>false</OobInline> -->
					<!-- <SoLingerTime>-1</SoLingerTime> -->
					<!-- <TcpNoDelay>false</TcpNoDelay> -->
					<AcceptorBackLog>100</AcceptorBackLog>
				</SocketConfiguration>
				<HTTPStreamerAdapterIDs>cupertinostreaming,smoothstreaming,sanjosestreaming,dvrchunkstreaming,mpegdashstreaming</HTTPStreamerAdapterIDs>
				<HTTPProviders>
					<HTTPProvider>
						<BaseClass>com.wowza.wms.http.HTTPCrossdomain</BaseClass>
						<RequestFilters>*crossdomain.xml</RequestFilters>
						<AuthenticationMethod>none</AuthenticationMethod>
					</HTTPProvider>
					<HTTPProvider>
						<BaseClass>com.wowza.wms.http.HTTPClientAccessPolicy</BaseClass>
						<RequestFilters>*clientaccesspolicy.xml</RequestFilters>
						<AuthenticationMethod>none</AuthenticationMethod>
					</HTTPProvider>
					<HTTPProvider>
						<BaseClass>com.wowza.wms.http.HTTPProviderMediaList</BaseClass>
						<RequestFilters>*jwplayer.rss|*jwplayer.smil|*medialist.smil|*manifest-rtmp.f4m</RequestFilters>
						<AuthenticationMethod>none</AuthenticationMethod>
					</HTTPProvider>
					<HTTPProvider>
						<BaseClass>com.wowza.wms.timedtext.http.HTTPProviderCaptionFile</BaseClass>
						<RequestFilters>*.ttml|*.srt|*.scc|*.vtt</RequestFilters>
						<AuthenticationMethod>none</AuthenticationMethod>
					</HTTPProvider>
					<HTTPProvider>
						<BaseClass>com.wowza.wms.http.HTTPServerVersion</BaseClass>
						<RequestFilters>*</RequestFilters>
						<AuthenticationMethod>none</AuthenticationMethod>
					</HTTPProvider>
				</HTTPProviders>
			</HostPort>
			<!-- 443 with SSL -->
			<!--
			<HostPort>
				<Name>Default SSL Streaming</Name>
				<Type>Streaming</Type>
				<ProcessorCount>${com.wowza.wms.TuningAuto}</ProcessorCount>
				<IpAddress>*</IpAddress>
				<Port>443</Port>
				<HTTPIdent2Response></HTTPIdent2Response>
				<SSLConfig>
					<KeyStorePath>${com.wowza.wms.context.VHostConfigHome}/conf/keystore.jks</KeyStorePath>
					<KeyStorePassword>[password]</KeyStorePassword>
					<KeyStoreType>JKS</KeyStoreType>
					<SSLProtocol>TLS</SSLProtocol>
					<Algorithm>SunX509</Algorithm>
					<CipherSuites></CipherSuites>
					<Protocols></Protocols>
				</SSLConfig>
				<SocketConfiguration>
					<ReuseAddress>true</ReuseAddress>
					<ReceiveBufferSize>65000</ReceiveBufferSize>
					<ReadBufferSize>65000</ReadBufferSize>
					<SendBufferSize>65000</SendBufferSize>
					<KeepAlive>true</KeepAlive>
					<AcceptorBackLog>100</AcceptorBackLog>
				</SocketConfiguration>
				<HTTPStreamerAdapterIDs>cupertinostreaming,smoothstreaming,sanjosestreaming,dvrchunkstreaming,mpegdashstreaming</HTTPStreamerAdapterIDs>
				<HTTPProviders>
					<HTTPProvider>
						<BaseClass>com.wowza.wms.http.HTTPCrossdomain</BaseClass>
						<RequestFilters>*crossdomain.xml</RequestFilters>
						<AuthenticationMethod>none</AuthenticationMethod>
					</HTTPProvider>
					<HTTPProvider>
						<BaseClass>com.wowza.wms.http.HTTPClientAccessPolicy</BaseClass>
						<RequestFilters>*clientaccesspolicy.xml</RequestFilters>
						<AuthenticationMethod>none</AuthenticationMethod>
					</HTTPProvider>
					<HTTPProvider>
						<BaseClass>com.wowza.wms.http.HTTPProviderMediaList</BaseClass>
						<RequestFilters>*jwplayer.rss|*jwplayer.smil|*medialist.smil|*manifest-rtmp.f4m</RequestFilters>
						<AuthenticationMethod>none</AuthenticationMethod>
					</HTTPProvider>
					<HTTPProvider>
						<BaseClass>com.wowza.wms.http.HTTPServerVersion</BaseClass>
						<RequestFilters>*</RequestFilters>
						<AuthenticationMethod>none</AuthenticationMethod>
					</HTTPProvider>
				</HTTPProviders>
			</HostPort>
			-->
			<!-- Admin HostPort -->
			<HostPort>
				<Name>Default Admin</Name>
				<Type>Admin</Type>
				<ProcessorCount>${com.wowza.wms.TuningAuto}</ProcessorCount>
				<IpAddress>*</IpAddress>
				<Port>8086</Port>
				<HTTPIdent2Response></HTTPIdent2Response>
				<SocketConfiguration>
					<ReuseAddress>true</ReuseAddress>
					<ReceiveBufferSize>16000</ReceiveBufferSize>
					<ReadBufferSize>16000</ReadBufferSize>
					<SendBufferSize>16000</SendBufferSize>
					<KeepAlive>true</KeepAlive>
					<AcceptorBackLog>100</AcceptorBackLog>
				</SocketConfiguration>
				<HTTPStreamerAdapterIDs></HTTPStreamerAdapterIDs>
				<HTTPProviders>
					<HTTPProvider>
						<BaseClass>com.wowza.wms.http.streammanager.HTTPStreamManager</BaseClass>
						<RequestFilters>streammanager*</RequestFilters>
						<AuthenticationMethod>admin-digest</AuthenticationMethod>
					</HTTPProvider>
					<HTTPProvider>
						<BaseClass>com.wowza.wms.http.HTTPServerInfoXML</BaseClass>
						<RequestFilters>serverinfo*</RequestFilters>
						<AuthenticationMethod>admin-digest</AuthenticationMethod>
					</HTTPProvider>
					<HTTPProvider>
						<BaseClass>com.wowza.wms.http.HTTPConnectionInfo</BaseClass>
						<RequestFilters>connectioninfo*</RequestFilters>
						<AuthenticationMethod>admin-digest</AuthenticationMethod>
					</HTTPProvider>
					<HTTPProvider>
						<BaseClass>com.wowza.wms.http.HTTPConnectionCountsXML</BaseClass>
						<RequestFilters>connectioncounts*</RequestFilters>
						<AuthenticationMethod>admin-digest</AuthenticationMethod>
					</HTTPProvider>
					<HTTPProvider>
						<BaseClass>com.wowza.wms.transcoder.httpprovider.HTTPTranscoderThumbnail</BaseClass>
						<RequestFilters>transcoderthumbnail*</RequestFilters>
						<AuthenticationMethod>admin-digest</AuthenticationMethod>
					</HTTPProvider>
					<HTTPProvider>
						<BaseClass>com.wowza.wms.http.HTTPProviderMediaList</BaseClass>
						<RequestFilters>medialist*</RequestFilters>
						<AuthenticationMethod>admin-digest</AuthenticationMethod>
					</HTTPProvider>
					<HTTPProvider>
						<BaseClass>com.wowza.wms.livestreamrecord.http.HTTPLiveStreamRecord</BaseClass>
						<RequestFilters>livestreamrecord*</RequestFilters>
						<AuthenticationMethod>admin-digest</AuthenticationMethod>
					</HTTPProvider>
					<HTTPProvider>
						<BaseClass>com.wowza.wms.http.HTTPServerVersion</BaseClass>
						<RequestFilters>*</RequestFilters>
						<AuthenticationMethod>none</AuthenticationMethod>
					</HTTPProvider>
				</HTTPProviders>
			</HostPort>
		</HostPortList>
		<HTTPStreamerAdapters>
			<HTTPStreamerAdapter>
				<ID>smoothstreaming</ID>
				<Name>smoothstreaming</Name>
				<Properties>
				</Properties>
			</HTTPStreamerAdapter>
			<HTTPStreamerAdapter>
				<ID>cupertinostreaming</ID>
				<Name>cupertinostreaming</Name>
				<Properties>
				</Properties>
			</HTTPStreamerAdapter>
			<HTTPStreamerAdapter>
				<ID>sanjosestreaming</ID>
				<Name>sanjosestreaming</Name>
				<Properties>
				</Properties>
			</HTTPStreamerAdapter>
			<HTTPStreamerAdapter>
				<ID>dvrchunkstreaming</ID>
				<Name>dvrchunkstreaming</Name>
				<Properties>
				</Properties>
			</HTTPStreamerAdapter>
			<HTTPStreamerAdapter>
				<ID>mpegdashstreaming</ID>
				<Name>mpegdashstreaming</Name>
				<Properties>
				</Properties>
			</HTTPStreamerAdapter>
		</HTTPStreamerAdapters>
		<!-- When set to zero, thread pool configuration is done in Server.xml -->
		<HandlerThreadPool>
			<PoolSize>0</PoolSize>
		</HandlerThreadPool>
		<TransportThreadPool>
			<PoolSize>0</PoolSize>
		</TransportThreadPool>
		<IdleWorkers>
			<WorkerCount>${com.wowza.wms.TuningAuto}</WorkerCount>
			<CheckFrequency>100</CheckFrequency>
			<MinimumWaitTime>5</MinimumWaitTime>
		</IdleWorkers>
		<NetConnections>
			<ProcessorCount>${com.wowza.wms.TuningAuto}</ProcessorCount>
			<IdleFrequency>500</IdleFrequency>
			<SocketConfiguration>
				<ReuseAddress>true</ReuseAddress>
				<ReceiveBufferSize>65000</ReceiveBufferSize>
				<ReadBufferSize>65000</ReadBufferSize>
				<SendBufferSize>65000</SendBufferSize>
				<KeepAlive>true</KeepAlive>
				<!-- <TrafficClass>0</TrafficClass> -->
				<!-- <OobInline>false</OobInline> -->
				<!-- <SoLingerTime>-1</SoLingerTime> -->
				<!-- <TcpNoDelay>false</TcpNoDelay> -->
				<AcceptorBackLog>100</AcceptorBackLog>
			</SocketConfiguration>
		</NetConnections>
		<MediaCasters>
			<ProcessorCount>${com.wowza.wms.TuningAuto}</ProcessorCount>
			<SocketConfiguration>
				<ReuseAddress>true</ReuseAddress>
				<ReceiveBufferSize>65000</ReceiveBufferSize>
				<ReadBufferSize>65000</ReadBufferSize>
				<SendBufferSize>65000</SendBufferSize>
				<KeepAlive>true</KeepAlive>
				<!-- <TrafficClass>0</TrafficClass> -->
				<!-- <OobInline>false</OobInline> -->
				<!-- <SoLingerTime>-1</SoLingerTime> -->
				<!-- <TcpNoDelay>false</TcpNoDelay> -->
				<ConnectionTimeout>10000</ConnectionTimeout>
			</SocketConfiguration>
		</MediaCasters>
		<LiveStreamTranscoders>
			<MaximumConcurrentTranscodes>0</MaximumConcurrentTranscodes>
		</LiveStreamTranscoders>
		<HTTPTunnel>
			<KeepAliveTimeout>2000</KeepAliveTimeout>
		</HTTPTunnel>
		<Client>
			<ClientTimeout>90000</ClientTimeout>
			<IdleFrequency>250</IdleFrequency>
		</Client>
		<!-- RTP/Authentication/Methods defined in Authentication.xml. Default setup includes; none, basic, digest -->
		<RTP>
			<IdleFrequency>100</IdleFrequency>
			<DatagramConfiguration>
				<Incoming>
					<ReuseAddress>true</ReuseAddress>
					<ReceiveBufferSize>1024000</ReceiveBufferSize>
					<SendBufferSize>65000</SendBufferSize>
					<!-- <MulticastBindToAddress>true</MulticastBindToAddress> -->
					<!-- <MulticastInterfaceAddress>192.168.1.22</MulticastInterfaceAddress> -->
					<!-- <TrafficClass>0</TrafficClass> -->
					<MulticastTimeout>50</MulticastTimeout>
					<DatagramMaximumPacketSize>4096</DatagramMaximumPacketSize>
				</Incoming>
				<Outgoing>
					<ReuseAddress>true</ReuseAddress>
					<ReceiveBufferSize>65000</ReceiveBufferSize>
					<SendBufferSize>65000</SendBufferSize>
					<!-- <MulticastBindToAddress>true</MulticastBindToAddress> -->
					<!-- <MulticastInterfaceAddress>192.168.1.22</MulticastInterfaceAddress> -->
					<!-- <TrafficClass>0</TrafficClass> -->
					<MulticastTimeout>50</MulticastTimeout>
					<DatagramMaximumPacketSize>4096</DatagramMaximumPacketSize>
				</Outgoing>
			</DatagramConfiguration>
			<UnicastIncoming>
				<ProcessorCount>${com.wowza.wms.TuningAuto}</ProcessorCount>
			</UnicastIncoming>
			<UnicastOutgoing>
				<ProcessorCount>${com.wowza.wms.TuningAuto}</ProcessorCount>
			</UnicastOutgoing>
			<MulticastIncoming>
				<ProcessorCount>${com.wowza.wms.TuningAuto}</ProcessorCount>
			</MulticastIncoming>
			<MulticastOutgoing>
				<ProcessorCount>${com.wowza.wms.TuningAuto}</ProcessorCount>
			</MulticastOutgoing>
		</RTP>
		<Application>
			<ApplicationTimeout>60000</ApplicationTimeout>
			<PingTimeout>12000</PingTimeout>
			<UnidentifiedSessionTimeout>30000</UnidentifiedSessionTimeout>
			<ValidationFrequency>20000</ValidationFrequency>
			<MaximumPendingWriteBytes>0</MaximumPendingWriteBytes>
			<MaximumSetBufferTime>60000</MaximumSetBufferTime>
		</Application>
		<StartStartupStreams>true</StartStartupStreams>
		<Manager>
			<TestPlayer>
				<IpAddress>${com.wowza.wms.HostPort.IpAddress}</IpAddress>
				<Port>${com.wowza.wms.HostPort.FirstStreamingPort}</Port>
				<SSLEnable>${com.wowza.wms.HostPort.SSLEnable}</SSLEnable>
			</TestPlayer>
			<!-- Properties defined are used by the Manager -->
			<Properties>
			</Properties>
		</Manager>
		<!-- Properties defined here will be added to the IVHost.getProperties() collection -->
		<Properties>
		</Properties>
	</VHost>
</Root>

Hi,

Please can you zip up your conf/ logs/ transcoder/ and manager/ and send to support@wowza.com. We can then try and determine the issue with you.

Andrew

Tried to reduce Wowza load on system by halving default threads which reduced load with a quarter.

Also turned off service WowzaStreamingEngineManager . We start it manually only when needed, to prevent additional troubleshooting hassle with load.

Not using transcoder. Mediacache was also disabled.

But Wowza is still only process on system with 2 digits CPU load, although there are only few connections (as noticed in fresh access logs):

Pid Owner Priority CPU % Memory % Command

12543 (Trace) (Kill) root 0 14.0 3.9 java -Xmx2000M -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:NewSize=128m -server -Djava.net.preferIPv4Stack=true -Dcom.sun.management.jmxremote=true -Dcom.wowza.wms.runmode=service -Dcom.wowza.wms.native.base=linux -Dcom.wowza.wms.AppHome=/usr/local/WowzaStreamingEngine -Dcom.wowza.wms.ConfigURL= -Dcom.wowza.wms.ConfigHome=/usr/local/WowzaStreamingEngine -cp /usr/local/WowzaStreamingEngine/bin/wms-bootstrap.jar com.wowza.wms.bootstrap.Bootstrap start

10626 (Trace) (Kill) mysql 0 3.4 15.8 /usr/sbin/mysqld --basedir=/usr --datadir=/var/lib/mysql --plugin-dir=/usr/lib64/mysql/plugin --user=mysql …

552 (Trace) (Kill) root -5 0.1 0.0 [kjournald]

30720 (Trace) (Kill) nobody 0 0.1 0.0 /usr/local/apache/bin/httpd -k start -DSSL

3207 (Trace) (Kill) root 0 0.0 3.4 /usr/local/cpanel/3rdparty/bin/clamd

Rest of processes use 0% CPU.

Zipped everything suggested:

zip -r debug conf/* logs/* transcoder/* manager/*

Archive is 48M because manager folder takes 73M (with 46M in manager/temp).

Will send this to support email.