MARC import improvement: 590$a

CharlasNew features

Únete a LibraryThing para publicar.

MARC import improvement: 590$a

Este tema está marcado actualmente como "inactivo"—el último mensaje es de hace más de 90 días. Puedes reactivarlo escribiendo una respuesta.

1lorannen
Jul 20, 2016, 11:13 am

We recently updated our MARC import system to capture the 590$a field, which now puts any data in that field in your MARC records into your "Comments" field on LT.

MARC import continues to live here: https://www.librarything.com/more/import.

2gilroy
Jul 20, 2016, 1:17 pm

So if we don't want that information, we now have to go in and delete the extraneous data?

3jjwilson61
Jul 20, 2016, 1:22 pm

You don't get the chance to reject book dimensions or subjects when adding books so why should you be able to reject comments?

4lorannen
Jul 20, 2016, 1:36 pm

>2 gilroy: That is correct. We've updated MARC import so that it captures more of the data from your original file, and there's no way to filter out specific fields on importing.

5lilithcat
Jul 20, 2016, 2:06 pm

>3 jjwilson61:

The difference is that the dimensions track the edition, while the comments are often unique to a specific copy of the work ("donated by X", "inscribed by the author").

6.Monkey.
Jul 20, 2016, 2:17 pm

I have yet to see any of the specific copy comments. The few I've gotten have been more broad.

7jjwilson61
Jul 20, 2016, 2:34 pm

>5 lilithcat: So are the subjects

8AnnieMod
Jul 20, 2016, 2:45 pm

One of the reasons I am either adding from Amazon or manually (Amazon may have its issues but it does not dump subjects that you cannot change and comments into my copies).

9MarthaJeanne
Jul 20, 2016, 2:49 pm

And the subjects you can't even delete.

10SylviaC
Jul 20, 2016, 8:31 pm

I had a comment imported that was not relevant to my copy. I've always considered Comments to be a field that is specific to my own book, so I really don't appreciate this. It's just another thing I have to watch for and edit.

11AnnieMod
Jul 20, 2016, 8:32 pm

12bnielsen
Jul 21, 2016, 5:50 am

>9 MarthaJeanne: I have a few subjects that aren't even in unicode utf-8 like the rest. Makes using the exported tsv file real fun :-)

13lorannen
Jul 21, 2016, 12:01 pm

>10 SylviaC: We're investigating. Oddly, I'm not seeing any import files in our system from your account. Messaging you privately to see what we can do.

14jjwilson61
Editado: Jul 21, 2016, 12:47 pm

This isn't just on mass imports though is it. I thought people were reporting that comments have been added from the MARC record when a book is added through the Add Book page.

15lorannen
Jul 21, 2016, 1:00 pm

>14 jjwilson61: No, the update only applies to MARC imports—it has not changed the way Add Books works.

16lorax
Jul 21, 2016, 1:03 pm

>15 lorannen:

There have been reports of non-user-added comments coming in from library sources:

https://www.librarything.com/topic/227147

17Lyndatrue
Jul 21, 2016, 1:29 pm

>15 lorannen: To restate what I'd already said on the thread that lorax posted the link to:

I don't use anything to import books. I add them, one at a time, from the Add Books menu (I'm picky, and I go through and make sure all the details are correct). I've seen garbage in the comment fields (including stray numbers that probably meant something to the library that I'd used as a source). I should state that anything *I* didn't put there is unwelcome. I use that field for things that don't belong in a review, and are still useful for others who might be looking at my copy (or for me, as well).

I then went back for three months (thank goodness I don't add a lot of books), just to make sure. It only showed up in the most recent editions, and only in three of them. Now I'm wishing I'd noted which source or sources, and saved what there was in the field.

18lorannen
Jul 21, 2016, 1:35 pm

>16 lorax: and >17 Lyndatrue: Thanks for following up. I was mistaken in >15 lorannen: —this did affect Add Books, as well, but, as many of you have indicated, that's bad, and we don't want datasource libraries' 590 data showing up in LT members' libraries.

We've narrowed down where the problem is, and are working on a fix—it should be resolved in the next few hours.

Basically, we want 590 fields to import from MARC import files into the LT Comments field, and we don't want them to be pulled in from library datasources when using Add Books.

19Collectorator
Jul 21, 2016, 1:40 pm

Este miembro ha sido suspendido del sitio.

20lorannen
Jul 21, 2016, 1:51 pm

>18 lorannen: And, fixed. You shouldn't be seeing any comments coming in from library datasources on Add Books now!

21SylviaC
Jul 21, 2016, 4:56 pm

>20 lorannen: Thank you! As you figured out, it was happening in Add Books, not import. I'm glad it was fixed.

22cesdemo
Nov 22, 2016, 6:06 pm

>18 lorannen: Comments are being pulled in from library datasources when adding a bunch of them via "universal import" from ISBN files (not a MARC import file) -- is that intended?

A selection of examples I'm seeing when adding books (probably obvious, but columns are: ISBN, library datasource, and comment which is added into the LT Comments field):

0152024255 University of Alberta UA Library copy a gift of Dr. Andrea Deakin.
0395510066 National Library of New Zealand Schools collection copies removed from plastic container.
0140544968 University of Michigan Printed in Colombia. The William A. Gosling Pop-up and Movable Book Collection.
0671798162 Los Angeles County Public Library Preschool-Grade 2.
0823411303 ILCSO (Illinois Libraries) OCLC
1880000059 ILCSO (Illinois Libraries) OCLC
0064450260 LIBROS Consortium meh.
2010025539 Los Angeles County Public Library Lawndale International Collection. Kindergarten and up.
0060220937 University of Michigan In the Lee Walp Family Juvenile Book Collection, Gift of the Lee Walp Family. In dust jacket. Manuscript notes by Lee Walp. Lee Walp's clippings, notes, etc. laid in.
0399208534 University of Michigan In original dust jacket. Gift of William A. Gosling.
006443009X Washington State University Grade level: Preschool. Grade level: Grades 1 through 3.
0590422715 Washington State University Grade level: Grades 1 through 3. Grade level: Grades 4 thorugh 6.
0060267887 ILCSO (Illinois Libraries) Curr. Center materials are restricted to N.P.U. campus use only.
0399210083 Toronto Public Library CORE
0808574884 Toronto Public Library CORE
0064451143 LIBROS Consortium cj.
0688099300 LIBROS Consortium cj.
0020430906 Metro Boston Library Network Cassette.
0590316818 Montana Shared Library Catalog c-1 BTSB 1-16-02 FTH
0805083367 LIBROS Consortium bb.
0670035696 ILCSO (Illinois Libraries) A65700075454 - c.1
0670058904 ILCSO (Illinois Libraries) A65700055111 - c.1

23lorannen
Nov 22, 2016, 7:05 pm

>22 cesdemo: So, to be clear, this is not a MARC import. Can you tell me which specific data sources you're using? I'll have ccatalfo take a look.

24cesdemo
Nov 22, 2016, 8:28 pm

>23 lorannen: Correct, not a MARC import - it's a csv import with ISBNs. I assume the original sources are what's shown in the middle column in >22 cesdemo: (with the corresponding ISBNs for each in the leftmost column), though at least some (perhaps most?) of these came to me via the Overcat source. Thanks!

25lorannen
Nov 22, 2016, 8:30 pm

>24 cesdemo: Yeah, looking at that again—where did you get these three columns from? There's no column for datasource in Universal Import, as it pulls from those you select on the import options page.

26cesdemo
Nov 23, 2016, 11:18 am

>25 lorannen: That was just a list I made (typing it into this box right here) to show some records I see which have imported comments questionably, sorry if the tabular format caused confusion. I got all that data from the "Your books" view - I made view E there show me "ISBN", "Source", and "Comments", and then copied & pasted those columns from rows with comments and formatted it into a table here. That's not the csv I'm importing (which as you point out of course doesn't have a comment field or a library datasource field).


As a side note, what I'm seeing here is "import gets too many fields," but I've also just filed a separate issue saying "import doesn't get enough fields..." :}

27lorannen
Nov 23, 2016, 9:49 pm

>26 cesdemo: Thanks for clarifying! The formatting looked specific, so I wanted to make sure I was looking in the right place(s) for this issue. I see your bug reports, as well. Thanks for the detailed info! Our developer ccatalfo has been working with imports a lot lately, so we should see some progress on this next week.