Iglistkit: Sporadic build/test failures

[rnystrom]

I keep seeing build errors. Not totally sure what this is. @jessesquires any ideas?

e.g. https://travis-ci.org/Instagram/IGListKit/jobs/192983683

Error Domain=IDETestOperationsObserverErrorDomain Code=12 "Failed to background test runner. If you believe this error represents a bug, please attach the log file at ..."

Here's the raw error:

2017-01-18 12:35:22.720 xcodebuild[1964:6537] Error Domain=IDETestOperationsObserverErrorDomain Code=12 "Failed to background test runner. If you believe this error represents a bug, please attach the log file at /Users/travis/Library/Developer/Xcode/DerivedData/IGListKitExamples-cfbxdbnpimeeplcoaiqrlyrrqjxn/Logs/Test/C85E98F2-F395-4148-A47F-4DFF374A3349/Session-IGListKitExamples-UITests-2017-01-18_123106-QT629f.log" UserInfo={NSLocalizedDescription=Failed to background test runner. If you believe this error represents a bug, please attach the log file at /Users/travis/Library/Developer/Xcode/DerivedData/IGListKitExamples-cfbxdbnpimeeplcoaiqrlyrrqjxn/Logs/Test/C85E98F2-F395-4148-A47F-4DFF374A3349/Session-IGListKitExamples-UITests-2017-01-18_123106-QT629f.log}
Testing failed:
    Test target IGListKitExamples-UITests encountered an error (Failed to background test runner. If you believe this error represents a bug, please attach the log file at /Users/travis/Library/Developer/Xcode/DerivedData/IGListKitExamples-cfbxdbnpimeeplcoaiqrlyrrqjxn/Logs/Test/C85E98F2-F395-4148-A47F-4DFF374A3349/Session-IGListKitExamples-UITests-2017-01-18_123106-QT629f.log)
** TEST FAILED **
The command "if [ $RUN_UI_TESTS == "YES" ] && [ $SDK == $IOS_SDK ]; then xcodebuild build test -workspace "$IOS_EXAMPLE_WORKSPACE" -scheme "$EXAMPLE_SCHEME" -sdk "$SDK" -destination "$DESTINATION" -configuration Debug ONLY_ACTIVE_ARCH=NO CODE_SIGNING_REQUIRED=NO | xcpretty -c; fi" exited with 65.

[jessesquires]

Hm... looks like flaky UI tests.

Everything runs ok locally?

[rnystrom]

Everything runs ok locally?

brb

[rnystrom]

@jessesquires ya it works. It's using iPhone 6s and iOS 10.1. Do we need to bump to 10.2?

[rnystrom]

Another random failure:

https://travis-ci.org/Instagram/IGListKit/jobs/191790549

Connection peer refused channel request for "dtxproxy:XCTestManager_IDEInterface:XCTestManager_DaemonConnectionInterface"; channel canceled
Error Domain=IDETestOperationsObserverErrorDomain Code=3 "The operation couldn’t be completed. (DTXProxyChannel error 1.) If you believe this error represents a bug, please attach the log file at

[jessesquires]

yeah we can see if 10.2 is more reliable

[zhubofei]

@rnystrom @jessesquires #432 failed on both 10.1 & 10.2
https://travis-ci.org/Instagram/IGListKit/jobs/194536882
https://travis-ci.org/Instagram/IGListKit/jobs/194536883

[jessesquires]

meh. i think this is as good as it's going to get

[Sherlouk]

Unless there genuinely is a test fail, there's not much we can do with inconsistent test results besides using the latest SDKs and hoping it gets improved upon

[jessesquires]

btw, we can always re-start the specific builds that fail in the travis-ci UI

(maybe only @rnystrom and i have permissions though)

[Sherlouk]

@jessesquires Just checked, can restart builds -- must be part of collaborator status!