Kill junk processes before build. Include serial integration tests
AbandonedAll Users
Actions

Authored by timcharper on Mar 23 2017, 5:18 AM.

Details

Reviewers

aquamatthias
jenkins
jeschkies

Commits

rMARATHON81a5c77c621a: Kill junk processes before build. Include serial integration tests

JIRA Issues

JIRA MARATHON-7036 Jenkins test suites appear to be leaking resources, contributing to flaky builds

Test Plan

n/a

Diff Detail

Repository

rMARATHON marathon

Lint

Automatic diff as part of commit; lint not applicable.

Unit

Automatic diff as part of commit; unit tests not applicable.

Changes from before your most recent comment are hidden. Show Older Changes

Could we put the logic in a shell script so I can execute it locally as well? That would help a lot :).

timcharper mentioned this in D643: extract kill-stale-test-processes to a script.Mar 23 2017, 4:57 PM

It was accidentally merged.

Revision Contents

			Path	Packages
M			Jenkinsfile (9 lines)

Diff	ID	Base	Description	Created	Lint	Unit
Base			Base
Diff 1	2363	5854c0a		Mar 23 2017, 5:18 AM	★	★
Diff 2	2364	5854c0a	rMARATHON81a5c77c621a0bb9e1166cda40a7297e5100d281	Mar 23 2017, 5:19 AM	★	★

Commit	Tree	Parents	Author	Summary	Date
131d3c093158	1d709518c94c	5854c0a746af	Tim Harper	Kill junk processes before build. Include serial integration tests (Show More…)	Mar 23 2017, 5:17 AM

Diff 2364

View Options

Jenkinsfile

Show All 34 Lines
35	35		*
36	36		* @param label The label for the stage and commit status context.
37	37		* @param block The block to execute in stage.
38	38		*/
39	39		def stageWithCommitStatus(label, block) {
40	40		stage(label) { withCommitStatus(label, block) }
41	41		}
42	42
43			node('JenkinsMarathonCI-Debian8-1-2017-02-23') { try {
	43		node('JenkinsMarathonCI-Debian8-1-2017-02-23') {
	44		try {
	45		stage("Kill junk processes") {
	46		sh "ps aux \| grep 'app_mock\\\|mesos\\\|java\\\|USER' \| grep -v slave.jar \| grep -v grep \| awk '{print \$2}' \| grep -v PID \| while read pid; do echo 'killing pid' \$pid; sudo kill -9 \$pid; done"
	47		}
		jeschkiesUnsubmitted Not Done I know what you are aiming but I don't think this is the right approach. We should rather find out why processes leak.
	48
44	49		stage("Checkout Repo") {
45	50		checkout scm
46	51		gitCommit = sh(returnStdout: true, script: 'git rev-parse HEAD').trim()
47	52		shortCommit = gitCommit.take(8)
48	53		currentBuild.displayName = "#${env.BUILD_NUMBER}: ${shortCommit}"
49	54		}
50	55		stageWithCommitStatus("1. Compile") {
51	56		try {
Show All 28 Lines
80	85		stageWithCommitStatus("3. Test Integration") {
81	86		try {
82	87		timeout(time: 30, unit: 'MINUTES') {
83	88		withEnv(['RUN_DOCKER_INTEGRATION_TESTS=true', 'RUN_MESOS_INTEGRATION_TESTS=true']) {
84	89		sh "sudo -E sbt -Dsbt.log.format=false clean coverage integration:test coverageReport mesos-simulation/integration:test"
85	90		}
86	91		}
87	92		} finally {
88			junit allowEmptyResults: true, testResults: 'target/test-reports/integration/*/.xml'
	93		junit allowEmptyResults: true, testResults: 'target/test-reports/integration//.xml'
89	94		// scoverage does not allow the configuration of a different output
90	95		// path: https://github.com/scoverage/sbt-scoverage/issues/211
91	96		// The archive steps does not allow a different target path. So we
92	97		// move the files to avoid conflicts with the reports from the unit
93	98		// test run.
94	99		sh "sudo mv target/scala-2.11/scoverage-report/ target/scala-2.11/scoverage-report-integration"
95	100		sh "sudo mv target/scala-2.11/coverage-report/cobertura.xml target/scala-2.11/coverage-report/cobertura-integration.xml"
96	101		archiveArtifacts(
▲ Show 20 Lines • Show All 99 Lines • Show Last 20 Lines