Fenix: [Bug] Investigate why Fenix installation pings aren't being seen

[liuche]

Just filing this bug so we have a way to keep track of discussion/findings around this investigation of the installation ping. This is the data we added in #7295.

According to @magorlick, she's not seeing any of these in the data dashboards.

What's confusing is these probes did go through QA and we were able to see them.

• Was the testing done in release builds?
• Is it somehow channel-specific?
• Is there anything that needs to be done on the Glean side?

Acceptance Criteria

• Missing pings are visible in dashboards, @magorlick to confirm

[sblatz]

QA: please test this with an organic install. Please let me know what Google ad ID you have so I can clear it from adjust!

[AndiAJ]

Hi, I've check this matter on both the latest Nightly Build #20840606 from 3/24 and Beta 4.2.0-beta.1 from 3/24 using the following devices:
• Google Pixel 3a (Android 10)
• Huawei Mate 20 Lite (Android 9)
• OnePlus A3 (Android 6.0.1)

OnePlus A3

► Adjust ID - cd4ee9bf-88c1-40cb-b3b1-43b2ff0239e3

✔️ Beta Organic installation Ping bcbe6c5e-5a55-4ad2-8f16-fdc029465252

03-24 17:58:23.074 22433-22640/? D/glean/BaseUploader: Glean ping to URL: /submit/org-mozilla-fenix-beta/installation/1/bcbe6c5e-5a55-4ad2-8f16-fdc029465252
    {
      "client_info": {
        "android_sdk_version": "23",
        "app_build": "20840349",
        "app_channel": "fenixBeta",
        "app_display_version": "4.2.0-beta.1",
        "architecture": "arm64-v8a",
        "client_id": "90efd3cd-029e-4c4f-9df4-3844f33f16a9",
        "device_manufacturer": "OnePlus",
        "device_model": "ONEPLUS A3000",
        "first_run_date": "2020-03-24+02:00",
        "locale": "en-US",
        "os": "Android",
        "os_version": "6.0.1",
        "telemetry_sdk_build": "25.0.0"
      },
      "metrics": {
        "datetime": {
          "installation.timestamp": "2020-03-24T17:58:19.381+02:00"
        },
        "string": {
          "installation.adgroup": "",
          "installation.campaign": "",
          "installation.creative": "",
          "installation.network": "Organic"
        }
      },
      "ping_info": {
        "end_time": "2020-03-24T17:58+02:00",
        "seq": 0,
        "start_time": "2020-03-24T17:58+02:00"
      }
    }
03-24 17:58:23.075 22433-22640/? D/glean/ConceptFetchHttpU: Submitting ping to: https://incoming.telemetry.mozilla.org/submit/org-mozilla-fenix-beta/installation/1/bcbe6c5e-5a55-4ad2-8f16-fdc029465252
03-24 17:58:23.377 22433-22640/? D/glean/ConceptFetchHttpU: Ping successfully sent (200)

Logcat
Glean dashboard

✔️ Nightly Organic installation Ping 599a8c8d-abb7-4981-a402-6194ff923019

03-24 18:01:14.577 23033-23267/? D/glean/BaseUploader: Glean ping to URL: /submit/org-mozilla-fenix-nightly/installation/1/599a8c8d-abb7-4981-a402-6194ff923019
    {
      "client_info": {
        "android_sdk_version": "23",
        "app_build": "20840606",
        "app_channel": "fenixNightly",
        "app_display_version": "Nightly 200324 06:00",
        "architecture": "arm64-v8a",
        "client_id": "d9c13fb7-3bce-40db-9d3e-a29aa1ce91ed",
        "device_manufacturer": "OnePlus",
        "device_model": "ONEPLUS A3000",
        "first_run_date": "2020-03-24+02:00",
        "locale": "en-US",
        "os": "Android",
        "os_version": "6.0.1",
        "telemetry_sdk_build": "25.0.0"
      },
      "metrics": {
        "datetime": {
          "installation.timestamp": "2020-03-24T18:01:11.434+02:00"
        },
        "string": {
          "installation.adgroup": "",
          "installation.campaign": "",
          "installation.creative": "",
          "installation.network": "Organic"
        }
      },
      "ping_info": {
        "end_time": "2020-03-24T18:01+02:00",
        "seq": 0,
        "start_time": "2020-03-24T18:01+02:00"
      }
    }
03-24 18:01:14.580 23033-23267/? D/glean/ConceptFetchHttpU: Submitting ping to: https://incoming.telemetry.mozilla.org/submit/org-mozilla-fenix-nightly/installation/1/599a8c8d-abb7-4981-a402-6194ff923019
03-24 18:01:14.742 1285-1703/? V/AlarmManager: Triggering alarm #0: Alarm{3b9d7f9 type 3 when 37398150 android}operation =Intent { act=android.content.jobscheduler.JOB_DELAY_EXPIRED }
03-24 18:01:14.927 23033-23267/? D/glean/ConceptFetchHttpU: Ping successfully sent (200)

Logcat
Glean dashboard

Google Pixel 3a

► Adjust ID - 51577905-af05-42b7-a0d4-72975aaddc2b

✔️ Beta Marketing campaign installation Ping 6cecd22c-cfc1-4ae2-91a2-f826eadda305

2020-03-24 18:04:35.833 22235-22493/? D/glean/BaseUploader: Glean ping to URL: /submit/org-mozilla-fenix-beta/installation/1/6cecd22c-cfc1-4ae2-91a2-f826eadda305
    {
      "client_info": {
        "android_sdk_version": "29",
        "app_build": "20840349",
        "app_channel": "fenixBeta",
        "app_display_version": "4.2.0-beta.1",
        "architecture": "arm64-v8a",
        "client_id": "15ec93b9-5781-4587-8e18-1c2297d315d7",
        "device_manufacturer": "Google",
        "device_model": "Pixel 3a",
        "first_run_date": "2020-03-24+02:00",
        "locale": "en-US",
        "os": "Android",
        "os_version": "10",
        "telemetry_sdk_build": "25.0.0"
      },
      "metrics": {
        "datetime": {
          "installation.timestamp": "2020-03-24T18:04:32.475+02:00"
        },
        "string": {
          "installation.adgroup": "twitter",
          "installation.campaign": "social",
          "installation.creative": "fr-gtm",
          "installation.network": "Product Marketing"
        }
      },
      "ping_info": {
        "end_time": "2020-03-24T18:04+02:00",
        "seq": 0,
        "start_time": "2020-03-24T18:04+02:00"
      }
    }
2020-03-24 18:04:35.834 22235-22493/? D/glean/ConceptFetchHttpUploader: Submitting ping to: https://incoming.telemetry.mozilla.org/submit/org-mozilla-fenix-beta/installation/1/6cecd22c-cfc1-4ae2-91a2-f826eadda305
2020-03-24 18:04:36.206 22235-22493/? D/glean/ConceptFetchHttpUploader: Ping successfully sent (200)

Logcat
Glean dashboard

✔️ Nightly Marketing campaign installation Ping 99e29972-bc04-4598-9d9d-ce2282cbf191

2020-03-24 18:06:49.022 22888-23174/? D/glean/BaseUploader: Glean ping to URL: /submit/org-mozilla-fenix-nightly/installation/1/99e29972-bc04-4598-9d9d-ce2282cbf191
    {
      "client_info": {
        "android_sdk_version": "29",
        "app_build": "20840606",
        "app_channel": "fenixNightly",
        "app_display_version": "Nightly 200324 06:00",
        "architecture": "arm64-v8a",
        "client_id": "b641c434-259a-4848-811e-06af2425d875",
        "device_manufacturer": "Google",
        "device_model": "Pixel 3a",
        "first_run_date": "2020-03-24+02:00",
        "locale": "en-US",
        "os": "Android",
        "os_version": "10",
        "telemetry_sdk_build": "25.0.0"
      },
      "metrics": {
        "datetime": {
          "installation.timestamp": "2020-03-24T18:06:45.091+02:00"
        },
        "string": {
          "installation.adgroup": "twitter",
          "installation.campaign": "social",
          "installation.creative": "fr-gtm",
          "installation.network": "Product Marketing"
        }
      },
      "ping_info": {
        "end_time": "2020-03-24T18:06+02:00",
        "seq": 0,
        "start_time": "2020-03-24T18:06+02:00"
      }
    }
2020-03-24 18:06:49.023 22888-23174/? D/glean/ConceptFetchHttpUploader: Submitting ping to: https://incoming.telemetry.mozilla.org/submit/org-mozilla-fenix-nightly/installation/1/99e29972-bc04-4598-9d9d-ce2282cbf191
2020-03-24 18:06:49.031 793-23179/? E/ResolverController: No valid NAT64 prefix (100, <unspecified>/0)
2020-03-24 18:06:49.213 793-23181/? E/ResolverController: No valid NAT64 prefix (100, <unspecified>/0)
2020-03-24 18:06:49.394 1385-6836/? D/WificondControl: Scan result ready event
2020-03-24 18:06:49.414 22888-23174/? D/glean/ConceptFetchHttpUploader: Ping successfully sent (200)

Logcat
Glean dashboard

Huawei Mate 20 Lite

► Adjust ID - d2e620ec-4c95-4a0c-8451-ab9056733e6c

✔️ Beta Organic installation Ping 9812f440-706d-4c5d-85e4-99107d3beaea

2020-03-24 18:12:22.894 19079-19352/? D/glean/BaseUploader: Glean ping to URL: /submit/org-mozilla-fenix-beta/installation/1/9812f440-706d-4c5d-85e4-99107d3beaea
    {
      "client_info": {
        "android_sdk_version": "28",
        "app_build": "20840349",
        "app_channel": "fenixBeta",
        "app_display_version": "4.2.0-beta.1",
        "architecture": "arm64-v8a",
        "client_id": "dd836adc-3e9b-431d-b715-689f14978d09",
        "device_manufacturer": "HUAWEI",
        "device_model": "SNE-LX1",
        "first_run_date": "2020-03-24+02:00",
        "locale": "en-GB",
        "os": "Android",
        "os_version": "9",
        "telemetry_sdk_build": "25.0.0"
      },
      "metrics": {
        "datetime": {
          "installation.timestamp": "2020-03-24T18:12:19.320+02:00"
        },
        "string": {
          "installation.adgroup": "",
          "installation.campaign": "",
          "installation.creative": "",
          "installation.network": "Organic"
        }
      },
      "ping_info": {
        "end_time": "2020-03-24T18:12+02:00",
        "seq": 0,
        "start_time": "2020-03-24T18:12+02:00"
      }
    }
2020-03-24 18:12:22.895 19079-19352/? D/glean/ConceptFetchHttpUploader: Submitting ping to: https://incoming.telemetry.mozilla.org/submit/org-mozilla-fenix-beta/installation/1/9812f440-706d-4c5d-85e4-99107d3beaea
2020-03-24 18:12:23.197 19079-19352/? D/glean/ConceptFetchHttpUploader: Ping successfully sent (200)

Logcat
Glean dashboard

✔️ Nightly Organic installation Ping 50718f16-06a8-4f41-a509-e352dc73c2e4

2020-03-24 18:16:16.939 19856-20207/? D/glean/BaseUploader: Glean ping to URL: /submit/org-mozilla-fenix-nightly/installation/1/50718f16-06a8-4f41-a509-e352dc73c2e4
    {
      "client_info": {
        "android_sdk_version": "28",
        "app_build": "20840606",
        "app_channel": "fenixNightly",
        "app_display_version": "Nightly 200324 06:00",
        "architecture": "arm64-v8a",
        "client_id": "280134e2-cd55-4fc1-b8fc-f19642a1e1c5",
        "device_manufacturer": "HUAWEI",
        "device_model": "SNE-LX1",
        "first_run_date": "2020-03-24+02:00",
        "locale": "en-GB",
        "os": "Android",
        "os_version": "9",
        "telemetry_sdk_build": "25.0.0"
      },
      "metrics": {
        "datetime": {
          "installation.timestamp": "2020-03-24T18:16:13.604+02:00"
        },
        "string": {
          "installation.adgroup": "",
          "installation.campaign": "",
          "installation.creative": "",
          "installation.network": "Organic"
        }
      },
      "ping_info": {
        "end_time": "2020-03-24T18:16+02:00",
        "seq": 0,
        "start_time": "2020-03-24T18:16+02:00"
      }
    }
2020-03-24 18:16:16.941 19856-20207/? D/glean/ConceptFetchHttpUploader: Submitting ping to: https://incoming.telemetry.mozilla.org/submit/org-mozilla-fenix-nightly/installation/1/50718f16-06a8-4f41-a509-e352dc73c2e4

Logcat
Glean dashboard

• In all three cases the installation pings were properly generated.
• I suspect that in the case of the Pixel 3a the installation ping isn't organic because it's the same device I've used to test #7295 which required the installation of Fenix through a marketing campaign.

@liuche & @sblatz - Please review and share your thoughts. ☺️

[sblatz]

@AndiAJ thanks so much for this thorough log. This all looks right to me! 😄

Going to follow up with Marissa to make sure this looks right on her end.