Caseflow: Investigate UNKNOWN Appeal status

[pkarman]

Description

ETL::Appeal.where(status: 'UNKNOWN').count
=> 514

Why?

[pkarman]

One example:

                                                ┌──────────────────────────────────────────────────────────────────────────┐
Appeal 11666 (direct_review) ────────────────── │ ID     │ STATUS    │ ASGN_BY    │ ASGN_TO      │ UPDATED_AT              │
└── RootTask                                    │ 277691 │ completed │            │ Bva          │ 2020-04-30 17:13:48 UTC │
    ├── TrackVeteranTask                        │ 277692 │ cancelled │            │ Vso          │ 2020-04-29 10:02:33 UTC │
    ├── DistributionTask                        │ 277693 │ completed │            │ Bva          │ 2020-02-14 16:45:24 UTC │
    │   └── InformalHearingPresentationTask     │ 277694 │ completed │            │ Vso          │ 2019-12-04 15:20:38 UTC │
    │       └── InformalHearingPresentationTask │ 494642 │ completed │ VACOWENDET │ BVAESCHULTZE │ 2019-12-04 15:20:38 UTC │
    ├── JudgeAssignTask                         │ 691909 │ completed │            │ BVAMHERMAN   │ 2020-02-20 16:46:42 UTC │
    ├── JudgeDecisionReviewTask                 │ 701603 │ completed │            │ BVAMHERMAN   │ 2020-04-28 14:55:01 UTC │
    │   ├── AttorneyTask                        │ 701604 │ completed │ BVAMHERMAN │ BVAJBURRO    │ 2020-03-23 21:07:37 UTC │
    │   └── AttorneyRewriteTask                 │ 778426 │ completed │ BVAMHERMAN │ BVAJBURRO    │ 2020-04-24 02:04:00 UTC │
    ├── BvaDispatchTask                         │ 859839 │ completed │            │ BvaDispatch  │ 2020-04-30 17:13:48 UTC │
    │   └── BvaDispatchTask                     │ 859840 │ completed │            │ BVALSCREDLE  │ 2020-04-30 17:13:48 UTC │
    ├── TrackVeteranTask                        │ 862451 │ completed │            │ Vso          │ 2020-04-30 17:13:48 UTC │
    └── InformalHearingPresentationTask         │ 862452 │ assigned  │            │ Vso          │ 2020-04-29 10:02:33 UTC │
                                                └──────────────────────────────────────────────────────────────────────────┘

[pkarman]

Another example:

                                                ┌────────────────────────────────────────────────────────────────────────────┐
Appeal 15554 (evidence_submission) ──────────── │ ID     │ STATUS      │ ASGN_BY     │ ASGN_TO     │ UPDATED_AT              │
└── RootTask                                    │ 310943 │ on_hold     │             │ Bva         │ 2019-08-06 13:23:11 UTC │
    ├── TrackVeteranTask                        │ 310944 │ in_progress │             │ Vso         │ 2019-08-06 13:23:11 UTC │
    ├── DistributionTask                        │ 310945 │ completed   │             │ Bva         │ 2020-03-23 21:09:21 UTC │
    │   ├── EvidenceSubmissionWindowTask        │ 310946 │ completed   │             │ MailTeam    │ 2019-09-25 00:30:16 UTC │
    │   └── InformalHearingPresentationTask     │ 429709 │ completed   │             │ Vso         │ 2020-01-24 17:03:07 UTC │
    │       └── InformalHearingPresentationTask │ 631256 │ completed   │ VACOWENDET  │ BVATJOYNER  │ 2020-01-24 17:03:07 UTC │
    ├── JudgeAssignTask                         │ 775695 │ completed   │             │ BVADBRENN   │ 2020-04-26 23:23:15 UTC │
    └── JudgeDecisionReviewTask                 │ 855127 │ on_hold     │ BVADBRENN   │ BVADBRENN   │ 2020-04-26 23:23:15 UTC │
        └── AttorneyTask                        │ 855128 │ on_hold     │ BVADBRENN   │ VACOOLDROR  │ 2020-04-30 12:36:42 UTC │
            └── TranslationColocatedTask        │ 866398 │ on_hold     │ VACOOLDROR  │ Translation │ 2020-04-30 12:36:42 UTC │
                └── TranslationTask             │ 866399 │ on_hold     │ VACOOLDROR  │ Translation │ 2020-05-04 12:54:15 UTC │
                    └── TranslationTask         │ 871865 │ assigned    │ VACOBENTOS1 │ VACOBENTOS1 │ 2020-05-04 12:54:15 UTC │
                                                └────────────────────────────────────────────────────────────────────────────┘

[pkarman]

                                                 ┌───────────────────────────────────────────────────────────────────────────────┐
Appeal 311 (hearing) ─────────────────────────── │ ID     │ STATUS    │ ASGN_BY    │ ASGN_TO           │ UPDATED_AT              │
└── RootTask                                     │ 374    │ completed │            │ Bva               │ 2019-09-09 13:07:48 UTC │
    ├── DistributionTask                         │ 48756  │ completed │            │ Bva               │ 2019-07-16 20:14:06 UTC │
    │   ├── InformalHearingPresentationTask      │ 375    │ cancelled │            │ Vso               │ 2019-03-05 22:47:17 UTC │
    │   └── HearingTask                          │ 48757  │ completed │            │ Bva               │ 2019-07-14 05:30:03 UTC │
    │       ├── ScheduleHearingTask              │ 48758  │ completed │            │ Bva               │ 2019-03-20 14:39:27 UTC │
    │       └── AssignHearingDispositionTask     │ 146920 │ completed │            │ Bva               │ 2019-07-14 05:30:03 UTC │
    │           ├── TranscriptionTask            │ 175526 │ completed │            │ TranscriptionTeam │ 2019-05-16 15:10:05 UTC │
    │           └── EvidenceSubmissionWindowTask │ 175527 │ completed │            │ MailTeam          │ 2019-07-14 05:30:02 UTC │
    ├── TrackVeteranTask                         │ 126460 │ completed │            │ Vso               │ 2019-07-05 19:18:46 UTC │
    ├── EvidenceOrArgumentMailTask               │ 257415 │ assigned  │            │ MailTeam          │ 2020-05-11 19:52:15 UTC │
    │   └── EvidenceOrArgumentMailTask           │ 257416 │ cancelled │ BVACANAGRO │ HearingAdmin      │ 2020-05-11 19:52:15 UTC │
    ├── EvidenceOrArgumentMailTask               │ 260195 │ assigned  │            │ MailTeam          │ 2020-05-11 19:52:14 UTC │
    │   └── EvidenceOrArgumentMailTask           │ 260196 │ cancelled │ BVACANAGRO │ HearingAdmin      │ 2020-05-11 19:52:14 UTC │
    ├── JudgeAssignTask                          │ 276939 │ completed │            │ BVADWIGHT         │ 2019-08-12 14:59:58 UTC │
    ├── JudgeDecisionReviewTask                  │ 324143 │ completed │            │ BVADWIGHT         │ 2019-09-09 12:37:57 UTC │
    │   └── AttorneyTask                         │ 324144 │ completed │ BVADWIGHT  │ VACOBLAKER        │ 2019-08-16 15:43:12 UTC │
    └── BvaDispatchTask                          │ 386050 │ completed │            │ BvaDispatch       │ 2019-09-09 13:07:48 UTC │
        └── BvaDispatchTask                      │ 386051 │ completed │            │ BVAEJAMES         │ 2019-09-09 13:07:48 UTC │
                                                 └───────────────────────────────────────────────────────────────────────────────┘

[pkarman]

This one has a status of "not distributed" but has a completed root task and open children.

UPDATE: hearings branch continues to work this. Its root task should be on_hold.

                                                       ┌────────────────────────────────────────────────────────────────────────────────┐
Appeal 31768 (hearing) ─────────────────────────────── │ ID     │ STATUS    │ ASGN_BY    │ ASGN_TO            │ UPDATED_AT              │
└── RootTask                                           │ 429801 │ completed │            │ Bva                │ 2020-05-14 13:15:31 UTC │
    ├── TrackVeteranTask                               │ 429802 │ cancelled │            │ Vso                │ 2019-11-14 11:07:10 UTC │
    ├── DistributionTask                               │ 429803 │ on_hold   │            │ Bva                │ 2020-03-06 19:41:27 UTC │
    │   ├── HearingTask                                │ 429804 │ cancelled │            │ Bva                │ 2019-09-25 10:44:02 UTC │
    │   │   ├── ScheduleHearingTask                    │ 429805 │ completed │            │ Bva                │ 2019-10-31 16:15:02 UTC │
    │   │   └── AssignHearingDispositionTask           │ 497722 │ cancelled │            │ Bva                │ 2019-10-31 16:15:02 UTC │
    │   ├── HearingTask                                │ 737692 │ cancelled │            │ Bva                │ 2020-03-05 16:01:48 UTC │
    │   │   └── ScheduleHearingTask                    │ 737693 │ cancelled │            │ Bva                │ 2020-03-05 16:01:48 UTC │
    │   ├── HearingTask                                │ 737802 │ cancelled │            │ Bva                │ 2020-03-05 16:02:56 UTC │
    │   │   └── ChangeHearingDispositionTask           │ 737803 │ cancelled │            │ HearingAdmin       │ 2020-03-05 16:02:56 UTC │
    │   ├── EvidenceSubmissionWindowTask               │ 737808 │ completed │            │ MailTeam           │ 2020-03-06 12:20:15 UTC │
    │   └── HearingTask                                │ 742378 │ on_hold   │            │ Bva                │ 2020-03-06 19:41:27 UTC │
    │       ├── ChangeHearingDispositionTask           │ 742379 │ cancelled │            │ HearingAdmin       │ 2020-03-09 11:21:43 UTC │
    │       └── ChangeHearingDispositionTask           │ 743256 │ on_hold   │ BVABMALONE │ BVABMALONE         │ 2020-05-26 12:05:23 UTC │
    │           ├── TranscriptionTask                  │ 745751 │ completed │            │ TranscriptionTeam  │ 2020-04-27 23:33:36 UTC │
    │           ├── EvidenceSubmissionWindowTask       │ 745752 │ completed │            │ MailTeam           │ 2020-03-24 11:36:27 UTC │
    │           ├── TranscriptionTask                  │ 913511 │ assigned  │            │ TranscriptionTeam  │ 2020-05-26 12:05:23 UTC │
    │           └── EvidenceSubmissionWindowTask       │ 913512 │ assigned  │            │ MailTeam           │ 2020-05-26 12:05:23 UTC │
    ├── AodMotionMailTask                              │ 485236 │ completed │            │ MailTeam           │ 2019-10-24 11:49:28 UTC │
    │   └── AodMotionMailTask                          │ 485237 │ completed │ BVABBARON  │ AodTeam            │ 2019-10-24 11:49:28 UTC │
    ├── TrackVeteranTask                               │ 517641 │ completed │            │ FieldVso           │ 2020-05-14 13:15:31 UTC │
    ├── TrackVeteranTask                               │ 517642 │ completed │            │ FieldVso           │ 2020-05-14 13:15:31 UTC │
    ├── JudgeAssignTask                                │ 740324 │ completed │            │ BVAJHAGER          │ 2020-03-06 12:46:56 UTC │
    ├── JudgeDecisionReviewTask                        │ 740368 │ cancelled │            │ BVAJHAGER          │ 2020-03-06 19:13:22 UTC │
    │   └── AttorneyTask                               │ 740369 │ cancelled │ BVAJHAGER  │ VACOSTYERH         │ 2020-03-06 19:13:22 UTC │
    ├── JudgeAssignTask                                │ 742260 │ completed │            │ BVAJHAGER          │ 2020-03-20 22:06:19 UTC │
    │   └── ScheduleHearingColocatedTask               │ 742296 │ completed │ BVAJHAGER  │ HearingsManagement │ 2020-03-06 19:39:15 UTC │
    ├── HearingTask                                    │ 742367 │ cancelled │            │ Bva                │ 2020-03-06 19:41:27 UTC │
    │   └── ScheduleHearingTask                        │ 742368 │ cancelled │            │ Bva                │ 2020-03-06 19:41:27 UTC │
    ├── JudgeDecisionReviewTask                        │ 772419 │ cancelled │            │ BVAJHAGER          │ 2020-04-29 19:28:38 UTC │
    │   └── AttorneyTask                               │ 772420 │ cancelled │ BVAJHAGER  │ BVABELWOOD         │ 2020-04-29 19:28:38 UTC │
    │       └── MissingHearingTranscriptsColocatedTask │ 776120 │ completed │ BVABELWOOD │ TranscriptionTeam  │ 2020-04-27 23:34:07 UTC │
    │           └── TranscriptionTask                  │ 776121 │ completed │ BVABELWOOD │ TranscriptionTeam  │ 2020-04-27 23:34:07 UTC │
    ├── EvidenceOrArgumentMailTask                     │ 776142 │ completed │            │ MailTeam           │ 2020-04-22 18:51:54 UTC │
    │   └── EvidenceOrArgumentMailTask                 │ 776143 │ completed │ VACOMCWILJ │ HearingAdmin       │ 2020-04-22 18:51:54 UTC │
    ├── EvidenceOrArgumentMailTask                     │ 814074 │ assigned  │            │ MailTeam           │ 2020-05-11 19:52:30 UTC │
    │   └── EvidenceOrArgumentMailTask                 │ 814075 │ cancelled │ VACOMCWILJ │ HearingAdmin       │ 2020-05-11 19:52:30 UTC │
    ├── JudgeAssignTask                                │ 865175 │ cancelled │            │ BVAJHAGER          │ 2020-04-29 19:29:26 UTC │
    ├── JudgeAssignTask                                │ 865179 │ cancelled │ BVAJHAGER  │ BVAMPETERS         │ 2020-05-01 20:07:37 UTC │
    ├── JudgeAssignTask                                │ 870663 │ cancelled │ BVAMPETERS │ BVATWESNER         │ 2020-05-05 03:04:41 UTC │
    ├── JudgeAssignTask                                │ 873991 │ completed │ BVATWESNER │ BVAMPETERS         │ 2020-05-05 13:20:29 UTC │
    ├── JudgeDecisionReviewTask                        │ 874778 │ completed │ BVAMPETERS │ BVAKBUCKLEY        │ 2020-05-14 11:46:54 UTC │
    │   └── AttorneyTask                               │ 874779 │ completed │ BVAMPETERS │ BVAJCONOLLY        │ 2020-05-13 23:10:39 UTC │
    └── BvaDispatchTask                                │ 895609 │ completed │            │ BvaDispatch        │ 2020-05-14 13:15:30 UTC │
        └── BvaDispatchTask                            │ 895610 │ completed │            │ VACOWILLIW         │ 2020-05-14 13:15:30 UTC │
                                                       └────────────────────────────────────────────────────────────────────────────────┘

[pkarman]

There are several buckets here.

• TrackVeteranTask open when root task is closed. This may require a nightly clean up job.
• InformalHearingPresentationTask open when root task is closed
• Post-dispatch tasks (like BoardGrantEffectuationTask) are legitimately open and do not have a parent task (not in the RootTask tree). #14450 adds a new status category to capture these.

Will update this list as more buckets are discovered.

[pkarman]

Task.descendants.map(&:name).each { |task_class| 
q = ETL::UnknownStatusWithOpenChildTaskQuery.new(task_class)
puts "#{task_class} -> #{q.call.count}"
}
AttorneyTask -> 354
AssignHearingDispositionTask -> 0
ColocatedTask -> 0
EvidenceSubmissionWindowTask -> 2
FoiaTask -> 367
HearingAdminActionTask -> 0
InformalHearingPresentationTask -> 53
JudgeTask -> 0
MailTask -> 0
PrivacyActTask -> 1
PulacCerulloTask -> 0
QualityReviewTask -> 1
ScheduleHearingTask -> 2
SpecialCaseMovementTask -> 0
TranslationTask -> 6
AbstractMotionToVacateTask -> 1
DecisionReviewTask -> 0
BvaDispatchTask -> 0
DecidedMotionToVacateTask -> 0
DistributionTask -> 0
HearingTask -> 3
NoShowHearingTask -> 1
RootTask -> 412
TrackVeteranTask -> 251
TimedHoldTask -> 0
TranscriptionTask -> 33
AttorneyDispatchReturnTask -> 0
AttorneyQualityReviewTask -> 0
AttorneyRewriteTask -> 13
ChangeHearingDispositionTask -> 1
PoaClarificationColocatedTask -> 0
IhpColocatedTask -> 0
HearingClarificationColocatedTask -> 0
AojColocatedTask -> 0
ExtensionColocatedTask -> 0
MissingHearingTranscriptsColocatedTask -> 33
UnaccreditedRepColocatedTask -> 0
FoiaColocatedTask -> 367
RetiredVljColocatedTask -> 0
ArnesonColocatedTask -> 0
NewRepArgumentsColocatedTask -> 0
PendingScanningVbmsColocatedTask -> 0
AddressVerificationColocatedTask -> 0
ScheduleHearingColocatedTask -> 0
StayedAppealColocatedTask -> 0
MissingRecordsColocatedTask -> 0
TranslationColocatedTask -> 6
OtherColocatedTask -> 1
PreRoutingColocatedTask -> 0
PreRoutingFoiaColocatedTask -> 0
PreRoutingMissingHearingTranscriptsColocatedTask -> 0
PreRoutingTranslationColocatedTask -> 0
HearingAdminActionContestedClaimantTask -> 0
HearingAdminActionFoiaPrivacyRequestTask -> 0
HearingAdminActionForeignVeteranCaseTask -> 0
HearingAdminActionIncarceratedVeteranTask -> 0
HearingAdminActionMissingFormsTask -> 0
HearingAdminActionOtherTask -> 0
HearingAdminActionVerifyAddressTask -> 0
HearingAdminActionVerifyPoaTask -> 0
JudgeAddressMotionToVacateTask -> 0
JudgeAssignTask -> 27
JudgeDispatchReturnTask -> 0
JudgeQualityReviewTask -> 1
JudgeDecisionReviewTask -> 379
AddressChangeMailTask -> 0
AodMotionMailTask -> 2
AppealWithdrawalMailTask -> 2
ClearAndUnmistakeableErrorMailTask -> 0
CongressionalInterestMailTask -> 0
ControlledCorrespondenceMailTask -> 1
DeathCertificateMailTask -> 0
EvidenceOrArgumentMailTask -> 19
ExtensionRequestMailTask -> 0
FoiaRequestMailTask -> 1
HearingRelatedMailTask -> 3
OtherMotionMailTask -> 1
PowerOfAttorneyRelatedMailTask -> 0
PrivacyActRequestMailTask -> 0
PrivacyComplaintMailTask -> 0
ReconsiderationMotionMailTask -> 6
ReturnedUndeliverableCorrespondenceMailTask -> 2
StatusInquiryMailTask -> 0
VacateMotionMailTask -> 1
BoardGrantEffectuationTask -> 24
VeteranRecordRequest -> 0
DeniedMotionToVacateTask -> 1
DismissedMotionToVacateTask -> 0

[pkarman]

considering the investigation piece closed. mitigations in other tickets.