Import and Export...more so imports
wdinzey@dpdsoftware.ca
11-3-18
Hi,

We have a client who processes a lot of transactions monthly. Last month the bank reconciliation file from one account contained over 15,000 records and this is a normal month. Their busy months run from December to March/April.

We have written a fairly powerful auto-reconciliation interface driven by rules which auto-create G/L transaction and then mark then as reconciled. Now we are importing, generating transaction and reconciling them but some of the transactions are being matched by string comparisons so the import is a bit tedious and slow (2 to 3 minutes).

When running this utility we are seeing clients on the network go dead and even the user running the import is getting the "Restart or Quit" message as the server is not responding. Of course, waiting a random amount of time the system returns to normal and processing can proceed.

We began thinking that what is needed is really to see import and export (again more so "import") moved to it's own stream within the application or something to this effect. This brought me to thinking what are other partners doing in these import heavy environments?


Is there anything existing in SERP and HAL that we can do to stop the import from hanging the system as we have a second client who moves items out (export aprox...2,000 items) for the purpose of building a catalog and they experience this issue as well. It is a small database but we are formatting the out file for them to use in their catalog builder but in any light this is not a real heavy workload.

Thanks in advance for all advise.

Giuseppe L.
11-3-18
Hello and thank you for reaching out to us with your topic.
This is a very specific question and I forwarded it to our dev department to see if they are aware of other partners who worked on such a requirement.
All others partners reading here are welcomed to advice.
Please stay tuned!

Giuseppe
HansaWorld Italy
Aldevinas Katkus
11-7-18
We would vote for the ability to do exports/imports in the background thread too. Fetching data via Rest API does not seem to disconnect logged users, so it may be could be possible to do the same with exports/imports.
wdinzey@dpdsoftware.ca
11-8-18
Effectively this is what we are seeing, the dependence on a single thread is causing a lot of issues and today's companies are playing with lots of data and our database and technology is not keeping pace. This is a serious negative when we are compared to our competitors and has we start turning heads here in North America we can expect to be "laughed out of the boardroom" per say when we take on serious players with money to pay for what we do.

Is HansaWorld paying attention to this trend? Can I get a response from the development team on what we can do.

Here is one of today's complaints.

"In follow up to our conversation this morning, please do keep me up to date with what hansaworlds response is re: import/exports not working while the server is querying a report.

Furthermore, could you look into why a particular report doesn't seem to pull in to the client consistently? Yesterday I got this report to populate, but today it just seems to run on in the server. I've had to shut it down 3 times now due to it being outstanding on the server and causing problems with Tinas & Matinas imports/exports.

CRM module > reports > Customer/Item Statistics"

Our clients are depending on SERP to help them and they are not able to work. HELP, please!!!!
Omar Dottin
12-27-19
Hey Wayne! As discussed, the Standard ERP Server architecture is designed so that when some maintenances or large reports are run, especially on Main Thread - it will stop clients to complete the maintenance or print report. In newer versions of 8.5, we have added Parallelity functionality to stop this from occurring (allows users to work completely without being affected during maintenance), but Parallelity has not yet been applied to work for every maintenance. Our goal is to apply this functionality to all maintenances and reports so that no user is affected during the time it is running. We will update you as more progress with this functionality occurs. Thanks!

Best Regards,
Omar
Leave Comment
You can subscribe to notifications for this post by selecting the 'star' icon on the top right corner of the post.
Back to the list
Latest Posts
Hi, Thank you for reaching out! What error do you get in server log and client log when you run the report? Please check that you have Multi Thread activated in Systems>>Settings>>O...
09:10 15 Apr 2024
Hello, Thank you for reaching out! We did testing in sample data in current released version 2024-03-16. This is not repeatable with this combination. We recommend you to report this as a bug w...
09:08 15 Apr 2024