Skip to content

Random errors on run flutter test with --coverage #35907

@mateusfsilva

Description

@mateusfsilva

Steps to Reproduce

Run flutter test --coverage on Flutter version > v1.5.3.

On every run, the errors below occur in a different test. We have more than 1,000 tests and the Flutter v1.5.3 runs without a problem.
If we run flutter test without the --coverage there is no problem.

MacBook Pro (Retina, 15-inch, Mid 2015)
2,2 GHz Intel Core i7
16 GB 1600 MHz DDR3
ProductName: Mac OS X (Mojave)
ProductVersion: 10.14.5
BuildVersion: 18F132

Logs

NoSuchMethodError: The getter 'iterator' was called on null.
  Receiver: null
  Tried calling: iterator
  dart:core-patch/object_patch.dart 50:5                         Object.noSuchMethod
  package:flutter_tools/src/test/coverage_collector.dart 181:51  _getAllCoverage
  ===== asynchronous gap ===========================
  dart:async/future_impl.dart 22:43                              _Completer.completeError
  dart:async-patch/async_patch.dart 40:18                        _AsyncAwaitCompleter.completeError
  package:flutter_tools/src/test/coverage_collector.dart         _getAllCoverage
  ===== asynchronous gap ===========================
  dart:async/zone.dart 1053:19                                   _CustomZone.registerUnaryCallback
  dart:async-patch/async_patch.dart 77:23                        _asyncThenWrapperHelper
  package:flutter_tools/src/test/coverage_collector.dart         _getAllCoverage
  package:flutter_tools/src/test/coverage_collector.dart 165:10  collect
  ===== asynchronous gap ===========================
  dart:async/zone.dart 1053:19                                   _CustomZone.registerUnaryCallback
  dart:async-patch/async_patch.dart 77:23                        _asyncThenWrapperHelper
  package:flutter_tools/src/test/coverage_collector.dart         collect
  package:flutter_tools/src/test/coverage_collector.dart 61:45   CoverageCollector.collectCoverage
  ===== asynchronous gap ===========================
  dart:async/zone.dart 1053:19                                   _CustomZone.registerUnaryCallback
  dart:async-patch/async_patch.dart 77:23                        _asyncThenWrapperHelper
  package:flutter_tools/src/test/flutter_platform.dart           FlutterPlatform._startTest
  package:flutter_tools/src/test/flutter_platform.dart 362:36    FlutterPlatform.loadChannel
  package:flutter_tools/src/test/flutter_platform.dart 315:46    FlutterPlatform.load
  ===== asynchronous gap ===========================
  dart:async/zone.dart 1053:19                                   _CustomZone.registerUnaryCallback
  dart:async-patch/async_patch.dart 77:23                        _asyncThenWrapperHelper
  package:test_core/src/runner/loader.dart                       Loader.loadFile.<fn>
  package:test_core/src/runner/load_suite.dart 98:31             new LoadSuite.<fn>.<fn>
  ===== asynchronous gap ===========================
  dart:async/zone.dart 1045:19                                   _CustomZone.registerCallback
  dart:async/zone.dart 962:22                                    _CustomZone.bindCallbackGuarded
  dart:async/timer.dart 52:45                                    new Timer
  dart:async/timer.dart 87:9                                     Timer.run
  dart:async/future.dart 174:11                                  new Future
  package:test_api/src/backend/invoker.dart 399:21               Invoker._onRun.<fn>.<fn>.<fn>

or

  NoSuchMethodError: The getter 'iterator' was called on null.
  Receiver: null
  Tried calling: iterator
  dart:core-patch/object_patch.dart 50:5                         Object.noSuchMethod
  package:flutter_tools/src/test/coverage_collector.dart 222:52  _buildCoverageMap
  package:flutter_tools/src/test/coverage_collector.dart 208:5   _getAllCoverage
  ===== asynchronous gap ===========================
  dart:async/future_impl.dart 22:43                              _Completer.completeError
  dart:async-patch/async_patch.dart 40:18                        _AsyncAwaitCompleter.completeError
  package:flutter_tools/src/test/coverage_collector.dart         _getAllCoverage
  ===== asynchronous gap ===========================
  dart:async/zone.dart 1053:19                                   _CustomZone.registerUnaryCallback
  dart:async-patch/async_patch.dart 77:23                        _asyncThenWrapperHelper
  package:flutter_tools/src/test/coverage_collector.dart         _getAllCoverage
  package:flutter_tools/src/test/coverage_collector.dart 165:10  collect
  ===== asynchronous gap ===========================
  dart:async/zone.dart 1053:19                                   _CustomZone.registerUnaryCallback
  dart:async-patch/async_patch.dart 77:23                        _asyncThenWrapperHelper
  package:flutter_tools/src/test/coverage_collector.dart         collect
  package:flutter_tools/src/test/coverage_collector.dart 61:45   CoverageCollector.collectCoverage
  ===== asynchronous gap ===========================
  dart:async/zone.dart 1053:19                                   _CustomZone.registerUnaryCallback
  dart:async-patch/async_patch.dart 77:23                        _asyncThenWrapperHelper
  package:flutter_tools/src/test/flutter_platform.dart           FlutterPlatform._startTest
  package:flutter_tools/src/test/flutter_platform.dart 362:36    FlutterPlatform.loadChannel
  package:flutter_tools/src/test/flutter_platform.dart 315:46    FlutterPlatform.load
  ===== asynchronous gap ===========================
  dart:async/zone.dart 1053:19                                   _CustomZone.registerUnaryCallback
  dart:async-patch/async_patch.dart 77:23                        _asyncThenWrapperHelper
  package:test_core/src/runner/loader.dart                       Loader.loadFile.<fn>
  package:test_core/src/runner/load_suite.dart 98:31             new LoadSuite.<fn>.<fn>
  ===== asynchronous gap ===========================
  dart:async/zone.dart 1045:19                                   _CustomZone.registerCallback
  dart:async/zone.dart 962:22                                    _CustomZone.bindCallbackGuarded
  dart:async/timer.dart 52:45                                    new Timer
  dart:async/timer.dart 87:9                                     Timer.run
  dart:async/future.dart 174:11                                  new Future
  package:test_api/src/backend/invoker.dart 399:21               Invoker._onRun.<fn>.<fn>.<fn>

flutter analyze

Analyzing blu-flutter...
No issues found! (ran in 6.5s)

flutter doctor -v

[✓] Flutter (Channel stable, v1.7.8+hotfix.3, on Mac OS X 10.14.5 18F132, locale pt-BR)
    • Flutter version 1.7.8+hotfix.3 at /Users/mateus.gustavo/desenvolvimento/flutter
    • Framework revision b712a172f9 (24 hours ago), 2019-07-09 13:14:38 -0700
    • Engine revision 54ad777fd2
    • Dart version 2.4.0


[✓] Android toolchain - develop for Android devices (Android SDK version 28.0.3)
    • Android SDK at /Users/mateus.gustavo/Library/Android/sdk
    • Android NDK location not configured (optional; useful for native profiling support)
    • Platform android-28, build-tools 28.0.3
    • ANDROID_HOME = /Users/mateus.gustavo/Library/Android/sdk
    • ANDROID_SDK_ROOT = /usr/local/share/android-sdk
    • Java binary at: /Applications/Android Studio.app/Contents/jre/jdk/Contents/Home/bin/java
    • Java version OpenJDK Runtime Environment (build 1.8.0_152-release-1343-b01)
    • All Android licenses accepted.

[✓] Xcode - develop for iOS and macOS (Xcode 10.2.1)
    • Xcode at /Applications/Xcode.app/Contents/Developer
    • Xcode 10.2.1, Build version 10E1001
    • CocoaPods version 1.7.4

[✓] iOS tools - develop for iOS devices
    • ios-deploy 1.9.4

[✓] Android Studio (version 3.4)
    • Android Studio at /Applications/Android Studio.app/Contents
    • Flutter plugin version 35.1.1
    • Dart plugin version 183.6270
    • Java version OpenJDK Runtime Environment (build 1.8.0_152-release-1343-b01)

[✓] IntelliJ IDEA Community Edition (version 2019.1.1)
    • IntelliJ at /Applications/IntelliJ IDEA CE.app
    • Flutter plugin version 31.3.4
    • Dart plugin version 183.4886.3

[✓] VS Code (version 1.36.1)
    • VS Code at /Applications/Visual Studio Code.app/Contents
    • Flutter extension version 3.2.0

[✓] Connected device (1 available)
    • iPhone de Minijobs • e3c4fd5389c129ebb1ad214365a57b6a7bc67269 • ios • iOS 12.1.3

• No issues found!

Metadata

Metadata

Assignees

No one assigned

    Labels

    r: timeoutIssue is closed due to author not providing the requested details in timetoolAffects the "flutter" command-line tool. See also t: labels.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions