[Dwight Bailey]

Oh, and the first field is the Connections ID#. I’m using that if editing, but you can choose not to map that field to test it as new entries:)

[Steven Zahm]

@ Dwight

I haven’t tried importing this yet to see if I could duplicate the issue because after looking at the file I see issues… I open the file in LibreOffice Calc setting the import to use Tabs as the field delimiter.

I see, what appears to be random XML and HTML tags in many of the fields. It is possible the CSV parser is having trouble with this. My first suggestion would to be to cleanup the CSV file. After you do, I’d love a copy of the cleaned up file.

In regards to the field enclosed by option, that is only important if you are using a comma or semicolon for the field separator.

[Steven Zahm]

@ Dwight

I imported this as is a few times and I was not able to duplicate the duplicate category issue. I will be releasing an update to both Connections and CSV Import on Friday with some minor tweaks I made while testing your CSV file. I doubt it’ll fix the issue for you, but it is worth a try.

The only suggestion I have for the duplicate category imports, before you import again, edit the categories that were being duplicated, delete the entire name and manually type them back in and save.

Hope this helps the issue you are experiencing!

[Dwight Bailey]

Hi, Steven.
Thank you so much for taking the time to test my large file! Yes, there is some HTML in some bios and custom fields (

<

p> and
tags mostly, and some links and ULs–and hidden in there there may be some tags I don’t know about). Are you saying that bios and custom fields can’t have html tags? If you can give me 1 or 2 examples of the types of tags you think might be causing a problem, I’ll be happy to ‘clean them up’. :)

Other than that, I’ll await the update, take your category renaming suggestion, and let you know how it goes. Are you saying to delete the category name, save, then edit the blank category and re-enter the name, or just delete/retype/save as one operation? (just checking; again, sorry for my confusion:)

[Steven Zahm]

@ Dwight

re: can give me 1 or 2 examples of the types of tags you think might be causing a problem

HTML in the bio/notes is fine… the tags I’m talking about can be found on line 50 of the CSV in the last name column. Here’s an example

Yost</lastname><firstname>Richard</firstname><middlename>A.</middlename><title>Gibson Professor</title><building>CLB</building><room>210A</room><phone>352-392-0557</phone><email>ryost@chem.ufl.edu</email><areas>faculty</areas><areas>analytical</areas><areas>bioanalytical</areas><areas>research</areas><division>Analytical</division><photo>yost</photo><fax>352-392-4651</fax><webpage>https://yost.chem.ufl.edu/</webpage><education>B.S., University of Arizona, 1974<br/>Ph.D., Michigan State, 1979</education><keywords>Analytical mass spectrometry</keywords><paragraph>Research in our group centers around three aspects of analytical mass spectrometry and related techniques: instrumentation, fundamentals, and applications. Instrumentation development includes projects in tandem mass spectrometry (MS/MS) and ion mobility, including the development of the first laser microprobe MS/MS system able to image trace levels of drugs and biomolecules in tissue specimens. Fundamental studies in our group employ both experiment and computer modeling/simulation to explore such issues as ion motion and ion-molecule interactions in high-field ion mobility. Applications of the techniques developed in our group include a wide range of studies in clinical, pharmacological, biotechnological, environmental, and forensic analysis.</paragraph></entry><!-- BEGIN EMERITUS FACULTY LISTING --><entry><lastname>Brey

All of this is in the last name field of that row. Others like this are scatter randomly throughout the file.

re: Are you saying to delete the category name, save, then edit the blank category and re-enter the name, or just delete/retype/save as one operation?

Do this as a single operation, only save once. Not sure if I ever tested saving an empty category name, not sure what would happen… just tested… I throw a user error telling them they need a name :) I must have been smarter that day.

[Dwight Bailey]

Oh wow, that definitely was XML code my PHP was supposed to filter out.
I’ve fixed that, and you can download the new cleaner file at the same link as before.

That file still created duplicate categories, though (again, only on rows with multiple categories separated by commas; rows with only one category do not create duplicates).

I wonder if it only does it when you upload the file the 2nd time? The first time I ran it, I set the “Entry ID” field to “Do Not Import” (otherwise, it can’t find an entry with that ID and doesn’t import any data). Then after that, I let it map the “Entry ID” field so it would update the existing data rather than create duplicate entries.

It’s not a big problem; I’ll try again after the next update.

Thanks again!!
Steve K. (working for Dwight:)

[Steven Zahm]

@ Dwight

Both the Connections update and CSV Import updates have been released.

I still have not been able to create the duplicate categories. Granted, I have not tried the a second import where I’m updating an entry from your CSV file… but that would not matter since it is literally the exact same code that processes categories regardless add or updating an entry. And that code is basically this… check if category exists, if not add it, and then link entry to all defined categories. A dozen or so lines of code.

[Dwight Bailey]

Ok, it seems that duplicate categories occur if there already is a category of the same name but with the FIRST letter capitalized. So (for example) the already-existing category for one was “Faculty” but the data had “faculty”. So if the new category is created during the import, subsequent entries with the same category cause multiple copies of this category, which then must be deleted. I think it also can happen if the shortcode isn’t identical as well. An example was a “physical” category with a short code “physical-research-areas” instead of just “physical”.

Also, I noticed that, when importing already-existing records using the Entry ID, if we have blank fields and there is existing data (specifically we tested the website and bio fields), the preexisting data is not deleted. So if we have fields that need to be erased during Import CSV, how would we do this?

I hope this gets you closer to figuring out what is happening.
:)
Steve K. (for Dwight).

[PatriciaB]

Is it possible to disable some of the fields available during import. The problem is that there are so many fields that we do not use and the ones we want to use I have had to add by following the “Custom Field – Adding a Text Field” quick tip that was posted. So when importing we have to scroll down a long list of fields that we don’t use to get to the custom fields that were added that we do use.
I would either like to:
1. disable the fields we don’t use so they don’t show up during the import session.
or
2. repurpose those fields that are already created by giving them a new name

Is this possible? Thank you.

[Steven Zahm]

@ PatriciaB

You can hook into the cncsv_map_import_fields and remove the fields that you do not wish to have show in the dropdown.

Hope that helps!

[Author]

Posts