talk@lists.collectionspace.org

Targeted discussion among implementers and between implementers and the CollectionSpace development team

View all threads

CSV Importer troubleshooting

HN
Hutcheson, Nathaniel D
Tue, Aug 1, 2023 2:00 PM

Hello,

I've got a CSpace installation on an Ubuntu VM that I've set up for testing, following the instructions I found herehttps://collectionspace.atlassian.net/wiki/spaces/DOC/pages/2715386463/Installing+on+Ubuntu+LTS.  I recently updated to version 7.1 and have been attempting to install the CSV Importer pluginhttps://github.com/collectionspace/collectionspace-csv-importer but have been running into some difficulties with the postgres docker conflicting with the local install on the VM.  While I can successfully start either the CSpace installation or the Importer on their respective ports, they both want access to postgres on 5432. I've had to stop/start postgres accordingly to get the desired application running, which has prevented me from being able to establish a connection in the Importer GUI to this point since it can't find the CSpace installation to verify the user credentials.

Any advice or direction would be greatly appreciated!

Best,
Nate

Nathaniel Hutcheson, MSIS

Systems Archivist

Briscoe Center for American History

The University of Texas at Austin

2300 Red River St.
Austin TX, 78712-1426

(512) 495-4163

n.hutcheson@austin.utexas.edu

http://www.cah.utexas.edu/http://www.cah.utexas.edu

Hello, I've got a CSpace installation on an Ubuntu VM that I've set up for testing, following the instructions I found here<https://collectionspace.atlassian.net/wiki/spaces/DOC/pages/2715386463/Installing+on+Ubuntu+LTS>. I recently updated to version 7.1 and have been attempting to install the CSV Importer plugin<https://github.com/collectionspace/collectionspace-csv-importer> but have been running into some difficulties with the postgres docker conflicting with the local install on the VM. While I can successfully start either the CSpace installation or the Importer on their respective ports, they both want access to postgres on 5432. I've had to stop/start postgres accordingly to get the desired application running, which has prevented me from being able to establish a connection in the Importer GUI to this point since it can't find the CSpace installation to verify the user credentials. Any advice or direction would be greatly appreciated! Best, Nate Nathaniel Hutcheson, MSIS Systems Archivist Briscoe Center for American History The University of Texas at Austin 2300 Red River St. Austin TX, 78712-1426 (512) 495-4163 n.hutcheson@austin.utexas.edu http://www.cah.utexas.edu/<http://www.cah.utexas.edu>
KS
Kristina Spurgin
Tue, Aug 1, 2023 4:52 PM

Hi Nate,

The CSV Importer is not so much a plugin for a given CollectionSpace instance as it is a separate web application that is used by lots of different CollectionSpace users to batch manipulate data in their respective CollectionSpace instances.

The assumption is that the CSV Importer and whatever instances of CollectionSpace use it are all running on their own servers. Because they are separate applications, they have separate databases and separate environments, and are completely independent from one another. The CollectionSpace application knows nothing about the CSV Importer. The CSV Importer only interacts with CollectionSpace via calls to its Services API (set up in the Importer user’s Connections).

If you can set up two separate VMs for the two applications, that’s probably the best way.

Otherwise, I’d search the CSV Importer codebase for “CSV_DB_PORT” and play around with changing that value (how and where exactly will depend on how you are running things). I believe this only works in the development and test environments. I suspect you will need to have two different Postgres-es running on two different ports for this to work. The CS application postgres db is completely different from the CSV Importer’s postgres db (different schema, different authentication, both independent of the other).

Alternately, if your test CollectionSpace instance can be set up so that it’s available via the web (outside your own machine), you can use https://importer.collectionspace.org to batch import into your instance. Note that the CSpace instance doesn't need to be permanently exposed via the web---you could forward a port to make it accessible only when you wanted to use the Importer.

Hope that helps some!

Kristina Spurgin (she/her) – Senior Data Migration Specialist – LYRASIS
kristina.spurgin@lyrasis.orgmailto:kristina.spurgin@lyrasis.org – 800-999-8558 x4815
https://orcid.org/0000-0003-1388-7061

From: Hutcheson, Nathaniel D n.hutcheson@austin.utexas.edu
Date: Tuesday, August 1, 2023 at 10:00
To: talk@lists.collectionspace.org talk@lists.collectionspace.org
Subject: [Talk] CSV Importer troubleshooting
Hello,

I've got a CSpace installation on an Ubuntu VM that I've set up for testing, following the instructions I found herehttps://collectionspace.atlassian.net/wiki/spaces/DOC/pages/2715386463/Installing+on+Ubuntu+LTS.  I recently updated to version 7.1 and have been attempting to install the CSV Importer pluginhttps://github.com/collectionspace/collectionspace-csv-importer but have been running into some difficulties with the postgres docker conflicting with the local install on the VM.  While I can successfully start either the CSpace installation or the Importer on their respective ports, they both want access to postgres on 5432. I've had to stop/start postgres accordingly to get the desired application running, which has prevented me from being able to establish a connection in the Importer GUI to this point since it can't find the CSpace installation to verify the user credentials.

Any advice or direction would be greatly appreciated!

Best,
Nate

Nathaniel Hutcheson, MSIS

Systems Archivist

Briscoe Center for American History

The University of Texas at Austin

2300 Red River St.
Austin TX, 78712-1426

(512) 495-4163

n.hutcheson@austin.utexas.edu

http://www.cah.utexas.edu/http://www.cah.utexas.edu

Hi Nate, The CSV Importer is not so much a plugin for a given CollectionSpace instance as it is a separate web application that is used by lots of different CollectionSpace users to batch manipulate data in their respective CollectionSpace instances. The assumption is that the CSV Importer and whatever instances of CollectionSpace use it are all running on their own servers. Because they are separate applications, they have separate databases and separate environments, and are completely independent from one another. The CollectionSpace application knows nothing about the CSV Importer. The CSV Importer only interacts with CollectionSpace via calls to its Services API (set up in the Importer user’s Connections). If you can set up two separate VMs for the two applications, that’s probably the best way. Otherwise, I’d search the CSV Importer codebase for “CSV_DB_PORT” and play around with changing that value (how and where exactly will depend on how you are running things). I believe this only works in the development and test environments. I suspect you will need to have two different Postgres-es running on two different ports for this to work. The CS application postgres db is completely different from the CSV Importer’s postgres db (different schema, different authentication, both independent of the other). Alternately, if your test CollectionSpace instance can be set up so that it’s available via the web (outside your own machine), you can use https://importer.collectionspace.org to batch import into your instance. Note that the CSpace instance doesn't need to be permanently exposed via the web---you could forward a port to make it accessible only when you wanted to use the Importer. Hope that helps some! -- Kristina Spurgin (she/her) – Senior Data Migration Specialist – LYRASIS kristina.spurgin@lyrasis.org<mailto:kristina.spurgin@lyrasis.org> – 800-999-8558 x4815 https://orcid.org/0000-0003-1388-7061 From: Hutcheson, Nathaniel D <n.hutcheson@austin.utexas.edu> Date: Tuesday, August 1, 2023 at 10:00 To: talk@lists.collectionspace.org <talk@lists.collectionspace.org> Subject: [Talk] CSV Importer troubleshooting Hello, I've got a CSpace installation on an Ubuntu VM that I've set up for testing, following the instructions I found here<https://collectionspace.atlassian.net/wiki/spaces/DOC/pages/2715386463/Installing+on+Ubuntu+LTS>. I recently updated to version 7.1 and have been attempting to install the CSV Importer plugin<https://github.com/collectionspace/collectionspace-csv-importer> but have been running into some difficulties with the postgres docker conflicting with the local install on the VM. While I can successfully start either the CSpace installation or the Importer on their respective ports, they both want access to postgres on 5432. I've had to stop/start postgres accordingly to get the desired application running, which has prevented me from being able to establish a connection in the Importer GUI to this point since it can't find the CSpace installation to verify the user credentials. Any advice or direction would be greatly appreciated! Best, Nate Nathaniel Hutcheson, MSIS Systems Archivist Briscoe Center for American History The University of Texas at Austin 2300 Red River St. Austin TX, 78712-1426 (512) 495-4163 n.hutcheson@austin.utexas.edu http://www.cah.utexas.edu/<http://www.cah.utexas.edu>