Arctos: Bulkload/Remove/Append specimen remarks

[Jegelewicz]

Is there a way to bulkload specimen remarks?

[dustymc]

Nope. I can SQL for you, a loader/unloader might be useful once we get to PG.

[Jegelewicz]

OK, I'll gather mys stuff and send a csv.

[campmlc]

Isn't this Collection Object Remarks?

On Thu, Mar 19, 2020 at 4:56 PM Teresa Mayfield-Meyer <
[email protected]> wrote:

• UNM-IT Warning:* This message was sent from outside of the LoboMail
  system. Do not click on links or open attachments unless you are sure the
  content is safe. (2.3)

OK, I'll gather mys stuff and send a csv.

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
https://github.com/ArctosDB/arctos/issues/2556#issuecomment-601454256,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ADQ7JBFEHFOPNDVQ3BA7WSTRIKPKXANCNFSM4LPX5QIQ
.

[Jegelewicz]

Yes, but I am adding them after the specimens are already there.

[campmlc]

Another one we should fix the terminology on.

On Fri, Mar 20, 2020 at 11:00 AM Teresa Mayfield-Meyer <
[email protected]> wrote:

• UNM-IT Warning:* This message was sent from outside of the LoboMail
  system. Do not click on links or open attachments unless you are sure the
  content is safe. (2.3)

Yes

—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/ArctosDB/arctos/issues/2556#issuecomment-601808321,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ADQ7JBHRSSDTZJBBPH2NWLDRIOOMRANCNFSM4LPX5QIQ
.

[Jegelewicz]

@dustymc will this work?
Collection Object Remarks Bulkload.zip

[dustymc]

@Jegelewicz yes looks like that'll work - can I just replace or do I need to check for existing and append as necessary?

"Specimen remarks" is one instance of coll_object_remark.coll_object_remarks.

[Jegelewicz]

Just in case, check for existing and append please. Thanks!

[dustymc]

A bunch of these look like "duplicates" - see eg http://arctos.database.museum/guid/NMMNH:Paleo:54689

Remarks: J-55

and from the file

NMMNH:Paleo:54689,J-55

append will result in J-55; J-55

Is that intentional?

temp_nm_cor.csv.zip

[Jegelewicz]

Nope. Can you remove the dupes or do I need to make a new file?

BTW - you're the best!

[dustymc]

UAM@ARCTOS> delete from temp_nm_cor where COLL_OBJECT_REMARKS=CURENTREM;

1426 rows deleted.

NMMNH:Paleo:36065
Spoil pile
28937396
spoil pile

UAM@ARCTOS> delete from temp_nm_cor where trim(upper(COLL_OBJECT_REMARKS))=trim(upper(CURENTREM));
7 rows deleted.

these were the obvious leftovers.

NMMNH:Paleo:57107
J-81 N. trench
28939225
J-81 North trench

NMMNH:Paleo:40297
Jacket 2 Screenwash
28937960
Jacket 2

PL/SQL procedure successfully completed.

[Jegelewicz]

Leaving this open as a request for a load/append/unload tool in PG.

[dustymc]

I'm digging the bulk unload/load mechanism/idea. "Append" is (in my brain...) just another step in the process; download, manipulate, delete, then load using the "original" data you downloaded mixed in with whatever you're trying to add. That also gives you a chance to make sure you're not appending the same thing, lets you control "delimiters," etc.

If that's not sufficient - if we want to add 'append' somewhere in the process - this is a great time to iron that out.

[Jegelewicz]

"Append" is (in my brain...) just another step in the process; download, manipulate, delete, then load using the "original" data you downloaded mixed in with whatever you're trying to add. That also gives you a chance to make sure you're not appending the same thing, lets you control "delimiters," etc.

That sounds like a good idea!

[campmlc]

I agree!

On Thu, Mar 26, 2020 at 9:33 AM Teresa Mayfield-Meyer <
[email protected]> wrote:

• UNM-IT Warning:* This message was sent from outside of the LoboMail
  system. Do not click on links or open attachments unless you are sure the
  content is safe. (2.3)

"Append" is (in my brain...) just another step in the process; download,
manipulate, delete, then load using the "original" data you downloaded
mixed in with whatever you're trying to add. That also gives you a chance
to make sure you're not appending the same thing, lets you control
"delimiters," etc.

That sounds like a good idea!

—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/ArctosDB/arctos/issues/2556#issuecomment-604498654,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ADQ7JBGH7TUR7GLVU5J6GXTRJNYUJANCNFSM4LPX5QIQ
.

[dustymc]

Can be done in component loader ecosystem.

[campmlc]

Great! Sounds like we need an internal webinar on how to use the component
loader system?

On Fri, Jan 22, 2021, 8:29 AM dustymc [e-mail] wrote:

• [EXTERNAL]*

Can be done in component loader ecosystem.

—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/ArctosDB/arctos/issues/2556#issuecomment-765484952,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/ADQ7JBBOGD4XO4W7IE337JLS3GKVHANCNFSM4LPX5QIQ
.

[dustymc]

how to use the component loader system

https://github.com/ArctosDB/arctos/issues/2974

[dustymc]

blocked by https://github.com/ArctosDB/arctos/issues/2974#issuecomment-779986500