This is a multi-part message in MIME format.

------=_NextPart_000_0013_01C1D187.4C0CC520
Content-Type: text/plain;
	charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

Hi friends,

I need your help for the following problem that we are encountering

We have a client application running in VB6.0 which populates the data 
from XML file into MS Access database.
The data access technology used is ADO.

Since the system is scaling , we are faced with performance problems. 
One situation is for an XML file of 10 MB size taking around 2 hrs. to 
load in.

Can somebody lead me to any resource for optimizing data access through 
ADO. What are the considerations to be taken care of.

I have to roll this out quite quickly. Waiting for help

Thanks and Regards

Parag Phanasgaonkar
Senior Software Engineer

Improvement is a journey, not a destination.

This is a multi-part message in MIME format.

------=_NextPart_000_0052_01C1D3DF.BF50DD00
Content-Type: text/plain;
	charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

Hi Parag,

DiZTEK is releasing (in the middle of next month) the Persistent 
Document Object Model or PDOM ActiveX and the new Persistent TreeView, 
which was totally redesigned to take advantage of the features of the 
PDOM. The product is complete, and has been under test and under 
real-life complex applications for the last 12 months.  We have spent 
all this time refining the product to provide the cleanest interface 
with capabilities for expansion.

We have a customer that implemented a 4GL DSP Development System using 
trees, and had to load an XML script with around 100000 nodes in four 
different trees. They have the same problem that you are exposing. The 
loading time of the trees was unacceptable; thier clients were 
complaining that to start the application, they had to wait around 3 
minutes before they could start using the application. We solved their 
problem by changing their trees with our persistent tree and now the 
application starts in less than 1 second, thier code is now simpler, 
faster,  and now they use XML to exchange information across satellite 
applications.. 

The PDOM uses MS-Access as its core database, can handle millions of  
nodes and because it is inherently persistent it only takes milliseconds 
to open a tree. 

You can load the PDOM with XML files that have millions of elements and 
attributes, and you only have to do it once.
The PDOM can search nodes and attributes under multiple query 
conditions, it can process, and manage your XML data under and object 
model, it is optimized to provide fast traversing and searching 
capabilities. You can consume, massage,   and generate XML, but the best 
thing is that you don't have to deal with it, it is used only for 
exchange.


For more information: www.diztek.com

If you are interested, I can submit to you a copy of the new PDOM's 
manual.

Regards

Eduardo Padilla

----- Original Message -----
  From: Parag Phanasgaonkar
  To: ActiveX_Data_Objects
  Sent: Thursday, March 21, 2002 11:22 PM
  Subject: [activex_data_objects] Help For optimization sought


  Hi friends,

  I need your help for the following problem that we are encountering

  We have a client application running in VB6.0 which populates the data 
from XML file into MS Access database.
  The data access technology used is ADO.

  Since the system is scaling , we are faced with performance problems. 
One situation is for an XML file of 10 MB size taking around 2 hrs. to 
load in.

  Can somebody lead me to any resource for optimizing data access 
through ADO. What are the considerations to be taken care of.

  I have to roll this out quite quickly. Waiting for help

  Thanks and Regards

  Parag Phanasgaonkar
  Senior Software Engineer

  Improvement is a journey, not a destination.

If your using Access XP you can use the Application.ImportXML method,
this enables you to import an xml file into an existing table, a new
table or just create a new table with the structure of your XML
document.

If not using XP then use an ADO recordset to open your XML file as a
persisted recordset then update your table in one hit with the
recordset.

The second option would give you more control over the process.  It
would be interesting to know which part of the process is proving the
most 
Intensive.  Is it the transfer of the file over HTTP? If so, I would
suggest a faster connection, if it's adding the data to the database
from
The file then the two options above may aid in the solution of your
problem.

Hope this helps

Guy Harwood
Research & Development Consultant
www.hcs-ltd.co.uk
 


-----Original Message-----
From: ActiveX_Data_Objects digest
[mailto:activex_data_objects@p...] 
Sent: 26 March 2002 23:00
To: activex_data_objects digest recipients
Subject: activex_data_objects digest: March 26, 2002


-----------------------------------------------
When replying to the digest, please quote only
relevant material, and edit the subject line to
reflect the message you are replying to.
-----------------------------------------------

The URL for this list is:
http://p2p.wrox.com/list.asp?list=activex_data_objects
ACTIVEX_DATA_OBJECTS Digest for Tuesday, March 26, 2002.

1. RE: activex_data_objects digest: March 22, 2002

----------------------------------------------------------------------

Subject: RE: activex_data_objects digest: March 22, 2002
From: "Parag Phanasgaonkar" <parag.phanasgaonkar@p...>
Date: Tue, 26 Mar 2002 09:46:02 +0530
X-Message-Number: 1

Hi,

The XML stream is coming over HTTP but is then loaded in the XML
DOMDocument on the local PC. Then I am using the DOM object to build a
dynamic SQL query by picking values and field names from elements in the
DOM object.

So you see that I am looping through the elements to build dynamic SQL
to insert each record and there are lots of records in my 10 MB file.

Is there any way to load XML faster into MS Access other than the way I
am following. Your help is appreciated.

Thanks and Regards

Parag Phanasgaonkar
Senior Software Engineer

Improvement is a journey, not a destination.
----- Original Message -----
From: "Guy Harwood" <guy@h...>
To: "ActiveX_Data_Objects" <activex_data_objects@p...>
Sent: Saturday, March 23, 2002 3:57 PM
Subject: [activex_data_objects] RE: activex_data_objects digest: March
22, 2002


> It would help if you could provide more detail on how you are actually

> loading The Xml.  Are you using a stream object over Http? Or are you 
> opening the
> Xml file from a file location into a persisted recordset?
>
> Guy Harwood
> Research & Development Consultant
> www.hcs-ltd.co.uk
>
>
>
> -----Original Message-----
> From: ActiveX_Data_Objects digest 
> [mailto:activex_data_objects@p...]
> Sent: 23 March 2002 00:00
> To: activex_data_objects digest recipients
> Subject: activex_data_objects digest: March 22, 2002
>
>
> -----------------------------------------------
> When replying to the digest, please quote only
> relevant material, and edit the subject line to
> reflect the message you are replying to.
> -----------------------------------------------
>
> The URL for this list is: 
> http://p2p.wrox.com/list.asp?list=activex_data_objects
> ACTIVEX_DATA_OBJECTS Digest for Friday, March 22, 2002.
>
> 1. Help For optimization sought
>
> ----------------------------------------------------------------------
>
> Subject: Help For optimization sought
> From: "Parag Phanasgaonkar" <parag.phanasgaonkar@p...>
> Date: Fri, 22 Mar 2002 09:52:36 +0530
> X-Message-Number: 1
>
> This is a multi-part message in MIME format.
>
> ------=_NextPart_000_0013_01C1D187.4C0CC520
> Content-Type: text/plain;
> charset="iso-8859-1"
> Content-Transfer-Encoding: quoted-printable
>
> Hi friends,
>
> I need your help for the following problem that we are encountering
>
> We have a client application running in VB6.0 which populates the data

> = from XML file into MS Access database. The data access technology 
> used is ADO.
>
> Since the system is scaling , we are faced with performance problems. 
> = One situation is for an XML file of 10 MB size taking around 2 hrs. 
> to = load in.
>
> Can somebody lead me to any resource for optimizing data access 
> through = ADO. What are the considerations to be taken care of.
>
> I have to roll this out quite quickly. Waiting for help
>
> Thanks and Regards
>
> Parag Phanasgaonkar
> Senior Software Engineer
>
> Improvement is a journey, not a destination.
>
> ------=_NextPart_000_0013_01C1D187.4C0CC520
> Content-Type: text/html;
> charset="iso-8859-1"
> Content-Transfer-Encoding: quoted-printable
>
> <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN"> 
> <HTML><HEAD> <META http-equiv=3DContent-Type content=3D"text/html; 
> charset=3Diso-8859-1">
> <META content=3D"MSHTML 6.00.2600.0" name=3DGENERATOR>
> <STYLE></STYLE>
> </HEAD>
> <BODY bgColor=3D#ffffff>
> <DIV><FONT face=3DArial color=3D#0000ff size=3D2>Hi 
> friends,</FONT></DIV>
> <DIV><FONT face=3DArial color=3D#0000ff size=3D2></FONT>&nbsp;</DIV>
> <DIV><FONT face=3DArial color=3D#0000ff size=3D2>I need your 
> help&nbsp;for the
> following problem that we are encountering</FONT></DIV>
> <DIV><FONT face=3DArial color=3D#0000ff size=3D2></FONT>&nbsp;</DIV>
> <DIV><FONT face=3DArial color=3D#0000ff size=3D2>We have a client 
> application running
> in VB6.0 which populates the data from XML file into MS Access
> database.</FONT></DIV>
> <DIV><FONT face=3DArial color=3D#0000ff size=3D2>The data access 
> technology used is
> ADO.</FONT></DIV>
> <DIV><FONT face=3DArial color=3D#0000ff size=3D2></FONT>&nbsp;</DIV>
> <DIV><FONT face=3DArial color=3D#0000ff size=3D2>Since the system is 
> scaling , we are
> faced with performance problems. One situation is for an XML file of
10
> 
> MB size
> taking around 2 hrs. to load in.</FONT></DIV>
> <DIV><FONT face=3DArial color=3D#0000ff size=3D2></FONT>&nbsp;</DIV>
> <DIV><FONT face=3DArial color=3D#0000ff size=3D2>Can somebody lead me
to
> 
> any resource
> for optimizing data access through ADO. What are the considerations to

> be taken
> care of.</FONT></DIV>
> <DIV><FONT face=3DArial color=3D#0000ff size=3D2></FONT>&nbsp;</DIV>
> <DIV><FONT face=3DArial color=3D#0000ff size=3D2>I have to roll this
out
> 
> quite
> quickly. Waiting for help</FONT></DIV>
> <DIV><FONT face=3DArial color=3D#0000ff size=3D2></FONT>&nbsp;</DIV>
> <DIV><FONT face=3DArial color=3D#0000ff size=3D2>Thanks and 
> Regards</FONT></DIV>
> <DIV><FONT face=3DArial color=3D#0000ff size=3D2></FONT>&nbsp;</DIV>
> <DIV><FONT face=3DArial color=3D#0000ff size=3D2>Parag 
> Phanasgaonkar<BR>Senior
> Software Engineer<BR></FONT><FONT face=3DArial color=3D#0000ff 
> size=3D2></FONT></DIV>
> <DIV><FONT face=3DArial color=3D#0000ff size=3D2>Improvement is a 
> journey, not a
> destination.</FONT></DIV>
> ---
> <BR>
> <BR>
> </BODY></HTML>
>
> ------=_NextPart_000_0013_01C1D187.4C0CC520--
>
>
>
>
> ---
>
> END OF DIGEST
>
> ---
> Change your mail options at http://p2p.wrox.com/manager.asp or to 
> unsubscribe send a blank email to 
>
>
>
>




---

END OF DIGEST