Mega Search
23.2 Million


Sign Up

Make a donation  
Slow Dumps on XE3 [Edit]  
News Group: embarcadero.public.interbase.general

Hello,

after migration from IB2009 to XE3 the generation of Dumps slows down from 15 Minutes to 7-8 Hours(!). 

DB-Size > 77 GB on MS Windows 2008 R2 with 1 TB Memory. 

Dumps are generating by using the Service Manager.

Someone any idea?

Thanx

Arek

Vote for best question.
Score: 0  # Vote:  0
Date Posted: 7-Nov-2014, at 9:05 AM EST
From: Arek W.
 
Re: Slow Dumps on XE3  
News Group: embarcadero.public.interbase.general
Note that the discussion of beta products is not appropriate here. 
Please use beta newsgroups for that.

Arek W. wrote:
> The new Beta of IB need with same Database 10 - 15 Minutes. It seems to be a bug in the Dump-Funktion.

Vote for best answer.
Score: 0  # Vote:  0
Date Posted: 10-Nov-2014, at 10:27 AM EST
From: quinn wildman
 
Re: Slow Dumps on XE3  
News Group: embarcadero.public.interbase.general
Hi Sriram,

we have installed the Version 11.0.4.817 of Interbase. The incremental Dump needs nearly the same time as the first Dump. Number of changed Pages was zero.

The new Beta of IB need with same Database 10 - 15 Minutes. It seems to be a bug in the Dump-Funktion.

Thanx 

Arek


> {quote:title=Sriram Balasubramanian wrote:}{quote}
> Arek,
> Just to get this out of the way, I hope you have installed the latest update to XE3 released earlier this year. http://cc.embarcadero.com/item/29883. This update has a fix to resolve the problem with Windows File System Cache related performance problems (especially since your database is not set direct I/O) and your database is VLDB (77DB+).
> 
> Also, do note that the "first" Online Dump process copies the whole database file to the target copy. If you have done a logical database in IB2009 (ODS 13) and restored in IBXE3 (now it is ODS 15), the new database is considered "fresh"; the first time you execute "Online Dump" against this ODS 15 database the full dump (all of 77GB) happens to the target dump file. A subsequent "Incremental Dump" to the same target will be much faster as only "changed" pages (possibly just MBs instead of GBs) in the s
ource database (ODS 15) will be copied over to the "dump" target. 
> 
> Can you do a "Incremental Dump" and see what you get?
> 
> When you execute "gbak -service localhost/gds_db:service_mgr -dump  " command, you will get some informational messages indicating how many database pages were "dumped" to the target. For a "full" initial dump this number will equal to the whole database file size, while a subsequent "incremental dump" (same options) will indicate only "changed" number of pages. Do let us know please what you observe for these commands.
> 
> Best wishes,
> Sriram
> 
> > {quote:title=Arek W. wrote:}{quote}
> > Hi Sriram,
> > 
> > No, nothing else changed. Same Windows Server Version and also 32Bit Version of Interbase.
> > 
> > Here the result of gstat -h
> > 
> > Database header page information:
> >         Flags                   0
> >         Checksum                12345
> >         Write timestamp         Nov 7, 2014 19:22:07
> >         Page size               8192
> >         ODS version             15.0
> >         Oldest transaction      455340
> >         Oldest active           455625
> >         Oldest snapshot         455625
> >         Next transaction        455626
> >         Sequence number         0
> >         Next attachment ID      0
> >         Implementation ID       16
> >         Shadow count            0
> >         Page buffers            250000
> >         Next header page        0
> >         Database dialect        1
> >         Creation date           Oct 25, 2014 9:18:50
> >         Attributes              force write
> > 
> >     Variable header data:
> >         Sweep interval:         25000
> >         *END*
> > 
> > Thanx
> > 
> > Arek
> > 
> > > {quote:title=Sriram Balasubramanian wrote:}{quote}
> > > Arek,
> > > 
> > > Simply upgrading from IB2009 to XE3 should not have resulted in this. 
> > > 
> > > 1. Has the underlying OS version changed?
> > > 2. Have you changed from 32bit to 64bit Edition of InterBase?
> > > 3. Can you cut and paste output of "gstat -h "?
> > > 
> > > Best wishes,
> > > Sriram
> > > 
> > > > {quote:title=Arek W. wrote:}{quote}
> > > > Hello,
> > > > 
> > > > after migration from IB2009 to XE3 the generation of Dumps slows down from 15 Minutes to 7-8 Hours(!). 
> > > > 
> > > > DB-Size > 77 GB on MS Windows 2008 R2 with 1 TB Memory. 
> > > > 
> > > > Dumps are generating by using the Service Manager.
> > > > 
> > > > Someone any idea?
> > > > 
> > > > Thanx
> > > > 
> > > > Arek

Vote for best answer.
Score: 0  # Vote:  0
Date Posted: 7-Nov-2014, at 2:17 PM EST
From: Arek W.
 
Re: Slow Dumps on XE3  
News Group: embarcadero.public.interbase.general
Arek,
Just to get this out of the way, I hope you have installed the latest update to XE3 released earlier this year. http://cc.embarcadero.com/item/29883. This update has a fix to resolve the problem with Windows File System Cache related performance problems (especially since your database is not set direct I/O) and your database is VLDB (77DB+).

Also, do note that the "first" Online Dump process copies the whole database file to the target copy. If you have done a logical database in IB2009 (ODS 13) and restored in IBXE3 (now it is ODS 15), the new database is considered "fresh"; the first time you execute "Online Dump" against this ODS 15 database the full dump (all of 77GB) happens to the target dump file. A subsequent "Incremental Dump" to the same target will be much faster as only "changed" pages (possibly just MBs instead of GBs) in the sou
rce database (ODS 15) will be copied over to the "dump" target. 

Can you do a "Incremental Dump" and see what you get?

When you execute "gbak -service localhost/gds_db:service_mgr -dump  " command, you will get some informational messages indicating how many database pages were "dumped" to the target. For a "full" initial dump this number will equal to the whole database file size, while a subsequent "incremental dump" (same options) will indicate only "changed" number of pages. Do let us know please what you observe for these commands.

Best wishes,
Sriram

> {quote:title=Arek W. wrote:}{quote}
> Hi Sriram,
> 
> No, nothing else changed. Same Windows Server Version and also 32Bit Version of Interbase.
> 
> Here the result of gstat -h
> 
> Database header page information:
>         Flags                   0
>         Checksum                12345
>         Write timestamp         Nov 7, 2014 19:22:07
>         Page size               8192
>         ODS version             15.0
>         Oldest transaction      455340
>         Oldest active           455625
>         Oldest snapshot         455625
>         Next transaction        455626
>         Sequence number         0
>         Next attachment ID      0
>         Implementation ID       16
>         Shadow count            0
>         Page buffers            250000
>         Next header page        0
>         Database dialect        1
>         Creation date           Oct 25, 2014 9:18:50
>         Attributes              force write
> 
>     Variable header data:
>         Sweep interval:         25000
>         *END*
> 
> Thanx
> 
> Arek
> 
> > {quote:title=Sriram Balasubramanian wrote:}{quote}
> > Arek,
> > 
> > Simply upgrading from IB2009 to XE3 should not have resulted in this. 
> > 
> > 1. Has the underlying OS version changed?
> > 2. Have you changed from 32bit to 64bit Edition of InterBase?
> > 3. Can you cut and paste output of "gstat -h "?
> > 
> > Best wishes,
> > Sriram
> > 
> > > {quote:title=Arek W. wrote:}{quote}
> > > Hello,
> > > 
> > > after migration from IB2009 to XE3 the generation of Dumps slows down from 15 Minutes to 7-8 Hours(!). 
> > > 
> > > DB-Size > 77 GB on MS Windows 2008 R2 with 1 TB Memory. 
> > > 
> > > Dumps are generating by using the Service Manager.
> > > 
> > > Someone any idea?
> > > 
> > > Thanx
> > > 
> > > Arek

Vote for best answer.
Score: 0  # Vote:  0
Date Posted: 7-Nov-2014, at 2:00 PM EST
From: Sriram Balasubramanian
 
Re: Slow Dumps on XE3  
News Group: embarcadero.public.interbase.general
Hi Sriram,

No, nothing else changed. Same Windows Server Version and also 32Bit Version of Interbase.

Here the result of gstat -h

Database header page information:
        Flags                   0
        Checksum                12345
        Write timestamp         Nov 7, 2014 19:22:07
        Page size               8192
        ODS version             15.0
        Oldest transaction      455340
        Oldest active           455625
        Oldest snapshot         455625
        Next transaction        455626
        Sequence number         0
        Next attachment ID      0
        Implementation ID       16
        Shadow count            0
        Page buffers            250000
        Next header page        0
        Database dialect        1
        Creation date           Oct 25, 2014 9:18:50
        Attributes              force write

    Variable header data:
        Sweep interval:         25000
        *END*

Thanx

Arek

> {quote:title=Sriram Balasubramanian wrote:}{quote}
> Arek,
> 
> Simply upgrading from IB2009 to XE3 should not have resulted in this. 
> 
> 1. Has the underlying OS version changed?
> 2. Have you changed from 32bit to 64bit Edition of InterBase?
> 3. Can you cut and paste output of "gstat -h "?
> 
> Best wishes,
> Sriram
> 
> > {quote:title=Arek W. wrote:}{quote}
> > Hello,
> > 
> > after migration from IB2009 to XE3 the generation of Dumps slows down from 15 Minutes to 7-8 Hours(!). 
> > 
> > DB-Size > 77 GB on MS Windows 2008 R2 with 1 TB Memory. 
> > 
> > Dumps are generating by using the Service Manager.
> > 
> > Someone any idea?
> > 
> > Thanx
> > 
> > Arek

Vote for best answer.
Score: 0  # Vote:  0
Date Posted: 7-Nov-2014, at 1:05 PM EST
From: Arek W.
 
Re: Slow Dumps on XE3  
News Group: embarcadero.public.interbase.general
Arek,

Simply upgrading from IB2009 to XE3 should not have resulted in this. 

1. Has the underlying OS version changed?
2. Have you changed from 32bit to 64bit Edition of InterBase?
3. Can you cut and paste output of "gstat -h "?

Best wishes,
Sriram

> {quote:title=Arek W. wrote:}{quote}
> Hello,
> 
> after migration from IB2009 to XE3 the generation of Dumps slows down from 15 Minutes to 7-8 Hours(!). 
> 
> DB-Size > 77 GB on MS Windows 2008 R2 with 1 TB Memory. 
> 
> Dumps are generating by using the Service Manager.
> 
> Someone any idea?
> 
> Thanx
> 
> Arek

Vote for best answer.
Score: 0  # Vote:  0
Date Posted: 7-Nov-2014, at 12:56 PM EST
From: Sriram Balasubramanian