Skip to content

P
Postgres FD Implementation
Commit 904ba3ff authored by Bruce Momjian's avatar Bruce Momjian
Browse files
Options

Update to ora2pg 1.2.

parent 911a4981
Hide whitespace changes
Inline Side-by-side
Showing with 949 additions and 554 deletions
contrib/oracle/CHANGES 0 → 100644
View file @ 904ba3ff
2001 05 09 - Initial version 1.0
2001 05 09 - Version 1.1
- Add table grant extraction based on group. Oracle ROLES are groups in PG
2001 05 11 - Version 1.2
- Views extraction is now really done with the option type=>'VIEWS'
- Add indexes extraction on tables.
- Changes name of constraints, default is now used.
- Add debug printing to see that the process is running :-)
- Add extraction of only required tablename.
- Add extraction of only n to n table indice. Indices of extraction can be obtained
with the option showtableid set to 1.
- Fix print of NOT NULL field.
- Complete rewrite of the grant extraction
- Complete rewrite of most things
contrib/oracle/Ora2Pg.pm
View file @ 904ba3ff
...@@ -18,7 +18,7 @@ use vars qw($VERSION); ...@@ -18,7 +18,7 @@ use vars qw($VERSION);
use Carp qw(confess); use Carp qw(confess);
use DBI; use DBI;
$VERSION = "1.1"; $VERSION = "1.2";
=head1 NAME =head1 NAME
...@@ -53,6 +53,50 @@ Ora2Pg - Oracle to PostgreSQL database schema converter ...@@ -53,6 +53,50 @@ Ora2Pg - Oracle to PostgreSQL database schema converter
exit(0); exit(0);
or if you only want to extract some tables:
# Create an instance of the Ora2Pg perl module
my @tables = ('tab1', 'tab2', 'tab3');
my $schema = new Ora2Pg (
datasource => $dbsrc, # Database DBD datasource
user => $dbuser, # Database user
password => $dbpwd, # Database password
tables => \@tables, # Tables to extract
debug => 1 # To show somethings when running
);
or if you only want to extract the 10 first tables:
# Create an instance of the Ora2Pg perl module
my $schema = new Ora2Pg (
datasource => $dbsrc, # Database DBD datasource
user => $dbuser, # Database user
password => $dbpwd, # Database password
max => 10 # 10 first tables to extract
);
or if you only want to extract tables 10 to 20:
# Create an instance of the Ora2Pg perl module
my $schema = new Ora2Pg (
datasource => $dbsrc, # Database DBD datasource
user => $dbuser, # Database user
password => $dbpwd, # Database password
min => 10 # Begin extraction at indice 10
max => 20 # End extraction at indice 20
);
To know at which indices table can be found during extraction use the option:
showtableid => 1
To extract all views set the option type as follow:
type => 'VIEW'
Default is table schema extraction
=head1 DESCRIPTION =head1 DESCRIPTION
...@@ -79,11 +123,13 @@ the connection parameters to the Oracle database. ...@@ -79,11 +123,13 @@ the connection parameters to the Oracle database.
Features must include: Features must include:
- database schema export (done) - Database schema export, with unique, primary and foreign key.
- grant export (done) - Grants/privileges export by user and group.
- predefined function/trigger export (todo) - Indexes and unique indexes export.
- data export (todo) - Table or view selection (by name and max table) export.
- sql query converter (todo) - Predefined function/trigger export (todo)
- Data export (todo)
- Sql query converter (todo)
My knowledge regarding database is really poor especially for Oracle My knowledge regarding database is really poor especially for Oracle
so contribution is welcome. so contribution is welcome.
...@@ -94,6 +140,7 @@ so contribution is welcome. ...@@ -94,6 +140,7 @@ so contribution is welcome.
You just need the DBI and DBD::Oracle perl module to be installed You just need the DBI and DBD::Oracle perl module to be installed
=head1 PUBLIC METHODS =head1 PUBLIC METHODS
=head2 new HASH_OPTIONS =head2 new HASH_OPTIONS
...@@ -105,6 +152,12 @@ Supported options are: ...@@ -105,6 +152,12 @@ Supported options are:
- datasource : DBD datasource (required) - datasource : DBD datasource (required)
- user : DBD user (optional with public access) - user : DBD user (optional with public access)
- password : DBD password (optional with public access) - password : DBD password (optional with public access)
- type : Type of data to extract, can be TABLE (default) or VIEW
- debug : Print the current state of the parsing
- tables : Extract only the given tables (arrayref)
- showtableid : Display only the table indice during extraction
- min : Indice to begin extraction. Default to 0
- max : Indice to end extraction. Default to 0 mean no limits
Attempt that this list should grow a little more because all initialization is Attempt that this list should grow a little more because all initialization is
done by this way. done by this way.
...@@ -174,8 +227,31 @@ sub _init ...@@ -174,8 +227,31 @@ sub _init
die "Error : $DBI::err ... $DBI::errstr\n"; die "Error : $DBI::err ... $DBI::errstr\n";
} }
$self->{debug} = 0;
$self->{debug} = 1 if ($options{debug});
$self->{limited} = ();
$self->{limited} = $options{tables} if ($options{tables});
$self->{min} = 0;
$self->{min} = $options{min} if ($options{min});
$self->{max} = 0;
$self->{max} = $options{max} if ($options{max});
$self->{showtableid} = 0;
$self->{showtableid} = $options{showtableid} if ($options{showtableid});
$self->{dbh}->{LongReadLen} = 0;
#$self->{dbh}->{LongTrunkOk} = 1;
# Retreive all table informations # Retreive all table informations
$self->_tables(); if (!exists $options{type} || ($options{type} eq 'TABLE')) {
$self->_tables();
} else {
$self->{dbh}->{LongReadLen} = 100000;
$self->_views();
}
# Disconnect from the database # Disconnect from the database
$self->{dbh}->disconnect() if ($self->{dbh}); $self->{dbh}->disconnect() if ($self->{dbh});
...@@ -199,8 +275,9 @@ to the table_info key as array reference. In other way: ...@@ -199,8 +275,9 @@ to the table_info key as array reference. In other way:
$self->{tables}{$class_name}{table_info} = [(OWNER,TYPE)]; $self->{tables}{$class_name}{table_info} = [(OWNER,TYPE)];
TYPE Can be TABLE, VIEW, SYSTEM TABLE, GLOBAL TEMPORARY, LOCAL TEMPORARY, DBI TYPE can be TABLE, VIEW, SYSTEM TABLE, GLOBAL TEMPORARY, LOCAL TEMPORARY,
ALIAS, SYNONYM or a data source specific type identifier. ALIAS, SYNONYM or a data source specific type identifier. This only extract
TABLE type.
It also get the following informations in the DBI object to affect the It also get the following informations in the DBI object to affect the
main hash of the database structure : main hash of the database structure :
...@@ -223,23 +300,46 @@ sub _tables ...@@ -223,23 +300,46 @@ sub _tables
my ($self) = @_; my ($self) = @_;
# Get all tables information given by the DBI method table_info # Get all tables information given by the DBI method table_info
print STDERR "Retrieving table information...\n" if ($self->{debug});
my $sth = $self->{dbh}->table_info or die $self->{dbh}->errstr; my $sth = $self->{dbh}->table_info or die $self->{dbh}->errstr;
my @tables_infos = $sth->fetchall_arrayref(); my @tables_infos = $sth->fetchall_arrayref();
if ($self->{showtableid}) {
foreach my $table (@tables_infos) {
for (my $i=0; $i<=$#{$table};$i++) {
print STDERR "[", $i+1, "] ${$table}[$i]->[2]\n";
}
}
return;
}
foreach my $table (@tables_infos) { foreach my $table (@tables_infos) {
# Set the table information for each class found # Set the table information for each class found
my $i = 1;
print STDERR "Min table dump set to $self->{min}.\n" if ($self->{debug} && $self->{min});
print STDERR "Max table dump set to $self->{max}.\n" if ($self->{debug} && $self->{max});
foreach my $t (@$table) { foreach my $t (@$table) {
# usually OWNER,TYPE. QUALIFIER is omitted until # Jump to desired extraction
# I know what to do with that next if (${@$t}[2] =~ /\$/);
$i++, next if ($self->{min} && ($i < $self->{min}));
last if ($self->{max} && ($i > $self->{max}));
next if (($#{$self->{limited}} >= 0) && !grep(/^${@$t}[2]$/, @{$self->{limited}}));
print STDERR "[$i] " if ($self->{max} || $self->{min});
print STDERR "Scanning ${@$t}[2] (@$t)...\n" if ($self->{debug});
# Check of uniqueness of the table
if (exists $self->{tables}{${@$t}[2]}{field_name}) {
print STDERR "Warning duplicate table ${@$t}[2], SYNONYME ? Skipped.\n";
next;
}
# usually OWNER,TYPE. QUALIFIER is omitted until I know what to do with that
$self->{tables}{${@$t}[2]}{table_info} = [(${@$t}[1],${@$t}[3])]; $self->{tables}{${@$t}[2]}{table_info} = [(${@$t}[1],${@$t}[3])];
# Set the fields information # Set the fields information
my $sth = $self->{dbh}->prepare("SELECT * FROM ${@$t}[1].${@$t}[2] WHERE 1=0"); my $sth = $self->{dbh}->prepare("SELECT * FROM ${@$t}[1].${@$t}[2] WHERE 1=0");
if (!defined($sth)) { if (!defined($sth)) {
$sth = $self->{dbh}->prepare("SELECT * FROM ${@$t}[1].${@$t}[2] WHERE 1=0"); warn "Can't prepare statement: $DBI::errstr";
if (!defined($sth)) { next;
warn "Can't prepare statement: $DBI::errstr";
next;
}
} }
$sth->execute; $sth->execute;
if ($sth->err) { if ($sth->err) {
...@@ -253,10 +353,67 @@ sub _tables ...@@ -253,10 +353,67 @@ sub _tables
@{$self->{tables}{${@$t}[2]}{primary_key}} = &_primary_key($self, ${@$t}[2]); @{$self->{tables}{${@$t}[2]}{primary_key}} = &_primary_key($self, ${@$t}[2]);
@{$self->{tables}{${@$t}[2]}{unique_key}} = &_unique_key($self, ${@$t}[2]); @{$self->{tables}{${@$t}[2]}{unique_key}} = &_unique_key($self, ${@$t}[2]);
@{$self->{tables}{${@$t}[2]}{foreign_key}} = &_foreign_key($self, ${@$t}[2]); @{$self->{tables}{${@$t}[2]}{foreign_key}} = &_foreign_key($self, ${@$t}[2]);
($self->{tables}{${@$t}[2]}{uniqueness}, $self->{tables}{${@$t}[2]}{indexes}) = &_get_indexes($self, ${@$t}[2]);
$self->{tables}{${@$t}[2]}{grants} = &_get_table_privilege($self, ${@$t}[2]);
$i++;
} }
} }
($self->{groups}, $self->{grants}) = &_get_privilege($self); print STDERR "Retrieving groups/users information...\n" if ($self->{debug});
$self->{groups} = &_get_roles($self);
}
=head2 _views
This function is used to retrieve all views information.
Set the main hash of the views definition $self->{views}.
Keys are the names of all views retrieved from the current
database values are the text definition of the views.
It then set the main hash as follow:
# Definition of the view
$self->{views}{$table}{text} = $view_infos{$table};
# Grants defined on the views
$self->{views}{$table}{grants} = when I find how...
=cut
sub _views
{
my ($self) = @_;
# Get all views information
print STDERR "Retrieving views information...\n" if ($self->{debug});
my %view_infos = &_get_views($self);
if ($self->{showtableid}) {
my $i = 1;
foreach my $table (sort keys %view_infos) {
print STDERR "[$i] $table\n";
$i++;
}
return;
}
print STDERR "Min view dump set to $self->{min}.\n" if ($self->{debug} && $self->{min});
print STDERR "Max view dump set to $self->{max}.\n" if ($self->{debug} && $self->{max});
my $i = 1;
foreach my $table (sort keys %view_infos) {
# Set the table information for each class found
# Jump to desired extraction
next if ($table =~ /\$/);
$i++, next if ($self->{min} && ($i < $self->{min}));
last if ($self->{max} && ($i > $self->{max}));
next if (($#{$self->{limited}} >= 0) && !grep(/^$table$/, @{$self->{limited}}));
print STDERR "[$i] " if ($self->{max} || $self->{min});
print STDERR "Scanning $table...\n" if ($self->{debug});
$self->{views}{$table}{text} = $view_infos{$table};
$i++;
}
} }
...@@ -271,12 +428,29 @@ sub _get_sql_data ...@@ -271,12 +428,29 @@ sub _get_sql_data
{ {
my ($self) = @_; my ($self) = @_;
my $sql_output = "-- Generated by Ora2Pg, the Oracle database Schema converter, version $VERSION\n"; my $sql_header = "-- Generated by Ora2Pg, the Oracle database Schema converter, version $VERSION\n";
$sql_output .= "-- Copyright 2000 Gilles DAROLD. All rights reserved.\n"; $sql_header .= "-- Copyright 2000 Gilles DAROLD. All rights reserved.\n";
$sql_output .= "-- Author : <gilles\@darold.net>\n\n"; $sql_header .= "--\n";
$sql_header .= "-- This program is free software; you can redistribute it and/or modify it under\n";
$sql_header .= "-- the same terms as Perl itself.\n\n";
my $sql_output = "";
# Process view only
if (exists $self->{views}) {
foreach my $view (sort keys %{$self->{views}}) {
$sql_output .= "CREATE VIEW $view AS $self->{views}{$view}{text};\n";
}
$sql_output .= "\n";
return $sql_header . $sql_output;
}
my @groups = ();
my @users = ();
# Dump the database structure as an XML Schema defintion # Dump the database structure as an XML Schema defintion
foreach my $table (keys %{$self->{tables}}) { foreach my $table (keys %{$self->{tables}}) {
print STDERR "Dumping table $table...\n" if ($self->{debug});
# Can be: TABLE, VIEW, SYSTEM TABLE, GLOBAL TEMPORARY, # Can be: TABLE, VIEW, SYSTEM TABLE, GLOBAL TEMPORARY,
$sql_output .= "CREATE ${$self->{tables}{$table}{table_info}}[1] \"\L$table\E\" (\n"; $sql_output .= "CREATE ${$self->{tables}{$table}{table_info}}[1] \"\L$table\E\" (\n";
my $sql_ukey = ""; my $sql_ukey = "";
...@@ -295,7 +469,7 @@ sub _get_sql_data ...@@ -295,7 +469,7 @@ sub _get_sql_data
} }
if (${$f}[4] ne "") { if (${$f}[4] ne "") {
$sql_output .= " DEFAULT ${$f}[4]"; $sql_output .= " DEFAULT ${$f}[4]";
} elsif (!${$f}[3]) { } elsif (!${$f}[3] || (${$f}[3] eq 'N')) {
$sql_output .= " NOT NULL"; $sql_output .= " NOT NULL";
} }
# Set the unique key definition # Set the unique key definition
...@@ -310,8 +484,8 @@ sub _get_sql_data ...@@ -310,8 +484,8 @@ sub _get_sql_data
} }
$sql_ukey =~ s/,$//; $sql_ukey =~ s/,$//;
$sql_pkey =~ s/,$//; $sql_pkey =~ s/,$//;
$sql_output .= "\tCONSTRAINT uk\L$table\E UNIQUE ($sql_ukey),\n" if ($sql_ukey); $sql_output .= "\tUNIQUE ($sql_ukey),\n" if ($sql_ukey);
$sql_output .= "\tCONSTRAINT pk\L$table\E PRIMARY KEY ($sql_pkey),\n" if ($sql_pkey); $sql_output .= "\tPRIMARY KEY ($sql_pkey),\n" if ($sql_pkey);
# Add constraint definition # Add constraint definition
foreach my $h (@{$self->{tables}{$table}{foreign_key}}) { foreach my $h (@{$self->{tables}{$table}{foreign_key}}) {
...@@ -323,25 +497,49 @@ sub _get_sql_data ...@@ -323,25 +497,49 @@ sub _get_sql_data
my $destname = "$desttable"; my $destname = "$desttable";
my $remote = "${${$h}{$link}{remote}}[$i]"; my $remote = "${${$h}{$link}{remote}}[$i]";
my $local = "${${$h}{$link}{local}}[$i]"; my $local = "${${$h}{$link}{local}}[$i]";
$sql_output .= "\tCONSTRAINT fk${i}_\L$table\E FOREIGN KEY ($local) REFERENCES $desttable ($remote),\n"; $sql_output .= "\tCONSTRAINT ${i}_\L$table\E_fk FOREIGN KEY ($local) REFERENCES $desttable ($remote),\n";
} }
} }
} }
$sql_output =~ s/,$//; $sql_output =~ s/,$//;
$sql_output .= ");\n"; $sql_output .= ");\n";
foreach my $idx (keys %{$self->{tables}{$table}{indexes}}) {
my $columns = join(',', @{$self->{tables}{$table}{indexes}{$idx}});
my $unique = '';
$unique = ' UNIQUE' if ($self->{tables}{$table}{uniqueness}{$idx} eq 'UNIQUE');
$sql_output .= "CREATE$unique INDEX \L$idx\E ON \L$table\E (\L$columns\E);\n";
}
# Add grant on this table
$sql_output .= "REVOKE ALL ON $table FROM PUBLIC;\n";
foreach my $grp (keys %{$self->{tables}{$table}{grants}}) {
if (exists $self->{groups}{$grp}) {
$sql_output .= "GRANT " . join(',', @{$self->{tables}{$table}{grants}{$grp}}) . " ON $table TO GROUP $grp;\n";
push(@groups, $grp) if (!grep(/^$grp$/, @groups));
} else {
$sql_output .= "GRANT " . join(',', @{$self->{tables}{$table}{grants}{$grp}}) . " ON $table TO $grp;\n";
push(@users, $grp) if (!grep(/^$grp$/, @users));
}
}
$sql_output .= "\n"; $sql_output .= "\n";
} }
# Add privilege definition # Add privilege definition
foreach my $role (keys %{$self->{groups}}) { print STDERR "Add groups/users privileges...\n" if ($self->{debug} && exists $self->{groups});
$sql_output .= "CREATE GROUP $role;\n"; my $grants = '';
$sql_output .= "ALTER GROUP $role ADD USERS " . join(',', @{$self->{groups}{$role}}) . ";\n"; foreach my $role (@groups) {
foreach my $grant (keys %{$self->{grants}{$role}}) { next if (!exists $self->{groups}{$role});
$sql_output .= "GRANT $grant ON " . join(',', @{$self->{grants}{$role}{$grant}}) . " TO GROUP $role;\n"; $grants .= "CREATE GROUP $role;\n";
$grants .= "ALTER GROUP $role ADD USERS " . join(',', @{$self->{groups}{$role}}) . ";\n";
foreach my $u (@{$self->{groups}{$role}}) {
push(@users, $u) if (!grep(/^$u$/, @users));
} }
} }
foreach my $u (@users) {
$sql_header .= "CREATE USER $u WITH PASSWORD 'secret';\n";
}
$sql_header .= "\n" . $grants . "\n";
return $sql_output; return $sql_header . $sql_output;
} }
...@@ -416,6 +614,11 @@ WHERE TABLE_NAME='$table' ...@@ -416,6 +614,11 @@ WHERE TABLE_NAME='$table'
END END
$sth->execute or die $sth->errstr; $sth->execute or die $sth->errstr;
my $data = $sth->fetchall_arrayref(); my $data = $sth->fetchall_arrayref();
if ($self->{debug}) {
foreach my $d (@$data) {
print STDERR "\t$d->[0] => type:$d->[1] , length:$d->[2] , nullable:$d->[3] , default:$d->[4]\n";
}
}
return @$data; return @$data;
...@@ -544,27 +747,52 @@ END ...@@ -544,27 +747,52 @@ END
} }
=head2 _get_privilege =head2 _get_table_privilege TABLE
This function implements a Oracle-native tables grants This function implements a Oracle-native table grants
information. information.
Return a hash of all groups (roles) with associated users Return a hash of array of all users and their grants on the
and a hash of arrays of all grants on related tables. given table.
=cut =cut
sub _get_privilege sub _get_table_privilege
{
my($self, $table) = @_;
my @pg_grants = ('DELETE','INSERT','SELECT','UPDATE');
# Retrieve all ROLES defined in this database
my $str = "SELECT GRANTEE, PRIVILEGE FROM DBA_TAB_PRIVS WHERE TABLE_NAME='$table' ORDER BY GRANTEE, PRIVILEGE";
my $sth = $self->{dbh}->prepare($str) or die $self->{dbh}->errstr;
$sth->execute or die $sth->errstr;
my %data = ();
while (my $row = $sth->fetch) {
push(@{$data{$row->[0]}}, $row->[1]) if (grep(/$row->[1]/, @pg_grants));
}
return \%data;
}
=head2 _get_roles
This function implements a Oracle-native roles/users
information.
Return a hash of all groups (roles) as an array of associated users.
=cut
sub _get_roles
{ {
my($self) = @_; my($self) = @_;
# Retrieve all ROLES defined in this database # Retrieve all ROLES defined in this database
my $sth = $self->{dbh}->prepare(<<END) or die $self->{dbh}->errstr; my $str = "SELECT ROLE FROM DBA_ROLES ORDER BY ROLE";
SELECT my $sth = $self->{dbh}->prepare($str) or die $self->{dbh}->errstr;
ROLE
FROM DBA_ROLES
ORDER BY ROLE
END
$sth->execute or die $sth->errstr; $sth->execute or die $sth->errstr;
my @roles = (); my @roles = ();
while (my $row = $sth->fetch) { while (my $row = $sth->fetch) {
...@@ -572,35 +800,115 @@ END ...@@ -572,35 +800,115 @@ END
} }
# Get all users associated to these roles # Get all users associated to these roles
my %data = ();
my %groups = (); my %groups = ();
foreach my $r (@roles) { foreach my $r (@roles) {
my $str = "SELECT GRANTEE FROM DBA_ROLE_PRIVS WHERE GRANTED_ROLE='$r' AND GRANTEE IN (SELECT USERNAME FROM DBA_USERS)"; my $str = "SELECT GRANTEE FROM DBA_ROLE_PRIVS WHERE GRANTEE <> 'SYS' AND GRANTEE <> 'SYSTEM' AND GRANTED_ROLE='$r' AND GRANTEE IN (SELECT USERNAME FROM DBA_USERS)";
$sth = $self->{dbh}->prepare($str) or die $self->{dbh}->errstr; $sth = $self->{dbh}->prepare($str) or die $self->{dbh}->errstr;
$sth->execute or die $sth->errstr; $sth->execute or die $sth->errstr;
my @users = (); my @users = ();
while (my $row = $sth->fetch) { while (my $row = $sth->fetch) {
next if ($row->[0] eq 'SYSTEM');
push(@users, $row->[0]); push(@users, $row->[0]);
} }
# Don't process roles relatives to DBA $groups{$r} = \@users if ($#users >= 0);
next if (grep(/^DBSNMP$/, @users)); }
next if (grep(/^SYS$/, @users));
$groups{$r} = \@users; return \%groups;
}
$str = "SELECT PRIVILEGE,TABLE_NAME FROM DBA_TAB_PRIVS WHERE GRANTEE='$r'";
$sth = $self->{dbh}->prepare($str) or die $self->{dbh}->errstr; =head2 _get_indexes TABLE
$sth->execute or die $sth->errstr;
my @grants = (); This function implements a Oracle-native indexes
while (my $row = $sth->fetch) { information.
push(@{$data{$r}{"${@$row}[0]"}}, ${@$row}[1]);
} Return an array of all indexes name which are not primary keys
for the given table.
Note: Indexes name must be created like this tablename_fieldname
else they will not be retrieved or if tablename false in the output
fieldname.
=cut
sub _get_indexes
{
my($self, $table) = @_;
# Retrieve all indexes
my $str = "SELECT DISTINCT DBA_IND_COLUMNS.INDEX_NAME, DBA_IND_COLUMNS.COLUMN_NAME, DBA_INDEXES.UNIQUENESS FROM DBA_IND_COLUMNS, DBA_INDEXES WHERE DBA_IND_COLUMNS.TABLE_NAME='$table' AND DBA_INDEXES.INDEX_NAME=DBA_IND_COLUMNS.INDEX_NAME AND DBA_IND_COLUMNS.INDEX_NAME NOT IN (SELECT CONSTRAINT_NAME FROM ALL_CONSTRAINTS WHERE TABLE_NAME='$table')";
my $sth = $self->{dbh}->prepare($str) or die $self->{dbh}->errstr;
$sth->execute or die $sth->errstr;
my %data = ();
my %unique = ();
while (my $row = $sth->fetch) {
$unique{$row->[0]} = $row->[2];
push(@{$data{$row->[0]}}, $row->[1]);
}
return \%unique, \%data;
}
=head2 _get_sequences TABLE
This function implements a Oracle-native sequence
information.
Return a hash of array of sequence name with MIN_VALUE, MAX_VALUE,
INCREMENT and LAST_NUMBER for the given table.
Not working yet.
=cut
sub _get_sequences
{
my($self, $table) = @_;
# Retrieve all indexes
my $str = "SELECT SEQUENCE_NAME, MIN_VALUE, MAX_VALUE, INCREMENT_BY, LAST_NUMBER FROM DBA_SEQUENCES WHERE SEQUENCE_OWNER <> 'SYS' AND SEQUENCE_OWNER <> 'SYSTEM'";
my $sth = $self->{dbh}->prepare($str) or die $self->{dbh}->errstr;
$sth->execute or die $sth->errstr;
my %data = ();
while (my $row = $sth->fetch) {
# next if ($row->[0] !~ /${table}_/);
# push(@data, $row->[0]);
}
return %data;
}
=head2 _get_views
This function implements a Oracle-native views information.
Return a hash of array of sequence name with MIN_VALUE, MAX_VALUE,
INCREMENT and LAST_NUMBER for the given table.
=cut
sub _get_views
{
my($self) = @_;
# Retrieve all views
my $str = "SELECT VIEW_NAME,TEXT FROM DBA_VIEWS WHERE OWNER <> 'SYS' AND OWNER <> 'SYSTEM'";
my $sth = $self->{dbh}->prepare($str) or die $self->{dbh}->errstr;
$sth->execute or die $sth->errstr;
my %data = ();
while (my $row = $sth->fetch) {
$data{$row->[0]} = $row->[1];
} }
return \%groups, \%data; return %data;
} }
1; 1;
__END__ __END__
......
contrib/oracle/README.ora2pg
View file @ 904ba3ff
Ora2Pg - Oracle to PostgreSQL database schema converter NAME
Ora2Pg - Oracle to PostgreSQL database schema converter
_________________________________________________________________
SYNOPSIS
SYNOPSIS BEGIN {
$ENV{ORACLE_HOME} = '/usr/local/oracle/oracle816';
BEGIN { }
$ENV{ORACLE_HOME} = '/usr/local/oracle/oracle816';
} use strict;
use strict; use Ora2Pg;
use Ora2Pg; # Init the database connection
my $dbsrc = 'dbi:Oracle:host=testdb.samse.fr;sid=TEST;port=1521';
# Init the database connection my $dbuser = 'system';
my $dbsrc = 'dbi:Oracle:host=testdb.samse.fr;sid=TEST;port=1521'; my $dbpwd = 'manager';
my $dbuser = 'system';
my $dbpwd = 'manager'; # Create an instance of the Ora2Pg perl module
my $schema = new Ora2Pg (
# Create an instance of the Ora2Pg perl module datasource => $dbsrc, # Database DBD datasource
my $schema = new Ora2Pg ( user => $dbuser, # Database user
datasource => $dbsrc, # Database DBD datasource password => $dbpwd, # Database password
user => $dbuser, # Database user );
password => $dbpwd, # Database password
); # Create the POSTGRESQL representation of all objects in the database
$schema->export_schema("output.sql");
# Create the POSTGRESQL representation of all objects in the database
$schema->export_schema("output.sql"); exit(0);
exit(0); or if you only want to extract some tables:
_________________________________________________________________
# Create an instance of the Ora2Pg perl module
DESCRIPTION my @tables = ('tab1', 'tab2', 'tab3');
my $schema = new Ora2Pg (
Ora2Pg is a perl OO module used to export an Oracle database schema to datasource => $dbsrc, # Database DBD datasource
a PostgreSQL compatible schema. user => $dbuser, # Database user
password => $dbpwd, # Database password
It simply connect to your Oracle database, extract its structure and tables => \@tables, # Tables to extract
generate a SQL script that you can load into your PostgreSQL database. debug => 1 # To show somethings when running
);
I'm not a Oracle DBA so I don't really know something about its
internal structure so you may find some incorrect things. Please tell or if you only want to extract the 10 first tables:
me what is wrong and what can be better.
# Create an instance of the Ora2Pg perl module
It currently only dump the database schema, with primary, unique and my $schema = new Ora2Pg (
foreign keys. I've tried to excluded internal system tables but datasource => $dbsrc, # Database DBD datasource
perhaps not enougt, please let me know. user => $dbuser, # Database user
_________________________________________________________________ password => $dbpwd, # Database password
max => 10 # 10 first tables to extract
ABSTRACT );
The goal of the Ora2Pg perl module is to cover all part needed to or if you only want to extract tables 10 to 20:
export an Oracle database to a PostgreSQL database without other thing
that provide the connection parameters to the Oracle database. # Create an instance of the Ora2Pg perl module
my $schema = new Ora2Pg (
Features must include: datasource => $dbsrc, # Database DBD datasource
user => $dbuser, # Database user
- database schema export (done) password => $dbpwd, # Database password
- grant export (done) min => 10 # Begin extraction at indice 10
- predefined function/trigger export (todo) max => 20 # End extraction at indice 20
- data export (todo) );
- sql query converter (todo)
To know at which indices table can be found during extraction use the
My knowledge regarding database is really poor especially for Oracle option:
so contribution is welcome.
_________________________________________________________________ showtableid => 1
REQUIREMENT To extract all views set the option type as follow:
You just need the DBI and DBD::Oracle perl module to be installed type => 'VIEW'
_________________________________________________________________
Default is table schema extraction
PUBLIC METHODS
_________________________________________________________________ DESCRIPTION
Ora2Pg is a perl OO module used to export an Oracle database schema to a
new HASH_OPTIONS PostgreSQL compatible schema.
Creates a new Ora2Pg object. It simply connect to your Oracle database, extract its structure and
generate a SQL script that you can load into your PostgreSQL database.
Supported options are:
I'm not a Oracle DBA so I don't really know something about its internal
- datasource : DBD datasource (required) structure so you may find some incorrect things. Please tell me what is
- user : DBD user (optional with public access) wrong and what can be better.
- password : DBD password (optional with public access)
It currently only dump the database schema, with primary, unique and
Attempt that this list should grow a little more because all foreign keys. I've tried to excluded internal system tables but perhaps
initialization is done by this way. not enougt, please let me know.
_________________________________________________________________
ABSTRACT
export_sql FILENAME The goal of the Ora2Pg perl module is to cover all part needed to export
an Oracle database to a PostgreSQL database without other thing that
Print SQL conversion output to a filename or to STDOUT if no file is provide the connection parameters to the Oracle database.
given.
_________________________________________________________________ Features must include:
PUBLIC METHODS - Database schema export, with unique, primary and foreign key.
_________________________________________________________________ - Grants/privileges export by user and group.
- Indexes and unique indexes export.
_init HASH_OPTIONS - Table or view selection (by name and max table) export.
- Predefined function/trigger export (todo)
Initialize a Ora2Pg object instance with a connexion to the Oracle - Data export (todo)
database. - Sql query converter (todo)
_________________________________________________________________
My knowledge regarding database is really poor especially for Oracle so
_tables contribution is welcome.
This function is used to retrieve all table information. REQUIREMENT
You just need the DBI and DBD::Oracle perl module to be installed
Set the main hash of the database structure $self->{tables}. Keys are
the names of all tables retrieved from the current database. Each PUBLIC METHODS
table information compose an array associated to the table_info key as new HASH_OPTIONS
array reference. In other way:
Creates a new Ora2Pg object.
$self->{tables}{$class_name}{table_info} = [(OWNER,TYPE)];
Supported options are:
TYPE Can be TABLE, VIEW, SYSTEM TABLE, GLOBAL TEMPORARY, LOCAL
TEMPORARY, ALIAS, SYNONYM or a data source specific type identifier. - datasource : DBD datasource (required)
- user : DBD user (optional with public access)
It also get the following informations in the DBI object to affect the - password : DBD password (optional with public access)
main hash of the database structure : - type : Type of data to extract, can be TABLE (default) or VIEW
- debug : Print the current state of the parsing
$self->{tables}{$class_name}{field_name} = $sth->{NAME}; - tables : Extract only the given tables (arrayref)
$self->{tables}{$class_name}{field_type} = $sth->{TYPE}; - showtableid : Display only the table indice during extraction
- min : Indice to begin extraction. Default to 0
It also call these other private subroutine to affect the main hash of - max : Indice to end extraction. Default to 0 mean no limits
the database structure :
Attempt that this list should grow a little more because all
@{$self->{tables}{$class_name}{column_info}} = &_column_info($self, $class_ initialization is done by this way.
name);
@{$self->{tables}{$class_name}{primary_key}} = &_primary_key($self, $class_ export_sql FILENAME
name);
@{$self->{tables}{$class_name}{unique_key}} = &_unique_key($self, $class_n Print SQL conversion output to a filename or to STDOUT if no file is
ame); given.
@{$self->{tables}{$class_name}{foreign_key}} = &_foreign_key($self, $class_
name); PUBLIC METHODS
_________________________________________________________________ _init HASH_OPTIONS
_get_sql_data Initialize a Ora2Pg object instance with a connexion to the Oracle
database.
Returns a string containing the entire SQL Schema definition
compatible with PostgreSQL _tables
_________________________________________________________________
This function is used to retrieve all table information.
_sql_type INTERNAL_TYPE LENGTH
Set the main hash of the database structure $self->{tables}. Keys are
This function return the PostgreSQL datatype corresponding to the the names of all tables retrieved from the current database. Each table
Oracle internal type. information compose an array associated to the table_info key as array
_________________________________________________________________ reference. In other way:
_column_info TABLE $self->{tables}{$class_name}{table_info} = [(OWNER,TYPE)];
This function implements a Oracle-native column information. DBI TYPE can be TABLE, VIEW, SYSTEM TABLE, GLOBAL TEMPORARY, LOCAL
TEMPORARY, ALIAS, SYNONYM or a data source specific type identifier.
Return a list of array reference containing the following informations This only extract TABLE type.
for each column the given a table
It also get the following informations in the DBI object to affect the
[( column name, column type, column length, nullable column, default main hash of the database structure :
value )]
_________________________________________________________________ $self->{tables}{$class_name}{field_name} = $sth->{NAME};
$self->{tables}{$class_name}{field_type} = $sth->{TYPE};
_primary_key TABLE
It also call these other private subroutine to affect the main hash of
This function implements a Oracle-native primary key column the database structure :
information.
@{$self->{tables}{$class_name}{column_info}} = &_column_info($self, $class_name);
Return a list of all column name defined as primary key for the given @{$self->{tables}{$class_name}{primary_key}} = &_primary_key($self, $class_name);
table. @{$self->{tables}{$class_name}{unique_key}} = &_unique_key($self, $class_name);
_________________________________________________________________ @{$self->{tables}{$class_name}{foreign_key}} = &_foreign_key($self, $class_name);
_unique_key TABLE _views
This function implements a Oracle-native unique key column This function is used to retrieve all views information.
information.
Set the main hash of the views definition $self->{views}. Keys are the
Return a list of all column name defined as unique key for the given names of all views retrieved from the current database values are the
table. text definition of the views.
_________________________________________________________________
It then set the main hash as follow:
_foreign_key TABLE
# Definition of the view
This function implements a Oracle-native foreign key reference $self->{views}{$table}{text} = $view_infos{$table};
information. # Grants defined on the views
$self->{views}{$table}{grants} = when I find how...
Return a list of hash of hash of array reference. Ouuf! Nothing very
difficult. The first hash is composed of all foreign key name. The _get_sql_data
second hash just have two key known as 'local' and remote'
corresponding to the local table where the foreign key is defined and Returns a string containing the entire SQL Schema definition compatible
the remote table where the key refer. with PostgreSQL
The foreign key name is composed as follow: _sql_type INTERNAL_TYPE LENGTH
'local_table_name->remote_table_name' This function return the PostgreSQL datatype corresponding to the Oracle
internal type.
Foreign key data consist in two array representing at the same indice
the local field and the remote field where the first one refer to the _column_info TABLE
second. Just like this:
This function implements a Oracle-native column information.
@{$link{$fkey_name}{local}} = @local_columns;
@{$link{$fkey_name}{remote}} = @remote_columns; Return a list of array reference containing the following informations
_________________________________________________________________ for each column the given a table
_get_privilege [( column name, column type, column length, nullable column, default
value )]
This function implements a Oracle-native tables grants information.
_primary_key TABLE
Return a hash of all groups (roles) with associated users and a hash
of arrays of all grants on related tables. This function implements a Oracle-native primary key column information.
_________________________________________________________________
Return a list of all column name defined as primary key for the given
AUTHOR table.
Gilles Darold <gilles@darold.net> _unique_key TABLE
_________________________________________________________________
This function implements a Oracle-native unique key column information.
COPYRIGHT
Return a list of all column name defined as unique key for the given
Copyright (c) 2001 Gilles Darold - All rights reserved. table.
This program is free software; you can redistribute it and/or modify _foreign_key TABLE
it under the same terms as Perl itself.
_________________________________________________________________ This function implements a Oracle-native foreign key reference
information.
BUGS
Return a list of hash of hash of array reference. Ouuf! Nothing very
This perl module is in the same state as my knowledge regarding difficult. The first hash is composed of all foreign key name. The
database, it can move and not be compatible with older version so I second hash just have two key known as 'local' and remote' corresponding
will do my best to give you official support for Ora2Pg. Your volontee to the local table where the foreign key is defined and the remote table
to help construct it and your contribution are welcome. where the key refer.
_________________________________________________________________
The foreign key name is composed as follow:
SEE ALSO
'local_table_name->remote_table_name'
DBI, DBD::Oracle
Foreign key data consist in two array representing at the same indice
the local field and the remote field where the first one refer to the
second. Just like this:
@{$link{$fkey_name}{local}} = @local_columns;
@{$link{$fkey_name}{remote}} = @remote_columns;
_get_table_privilege TABLE
This function implements a Oracle-native table grants information.
Return a hash of array of all users and their grants on the given table.
_get_roles
This function implements a Oracle-native roles/users information.
Return a hash of all groups (roles) as an array of associated users.
_get_indexes TABLE
This function implements a Oracle-native indexes information.
Return an array of all indexes name which are not primary keys for the
given table.
Note: Indexes name must be created like this tablename_fieldname else
they will not be retrieved or if tablename false in the output
fieldname.
_get_sequences TABLE
This function implements a Oracle-native sequence information.
Return a hash of array of sequence name with MIN_VALUE, MAX_VALUE,
INCREMENT and LAST_NUMBER for the given table.
Not working yet.
_get_views
This function implements a Oracle-native views information.
Return a hash of array of sequence name with MIN_VALUE, MAX_VALUE,
INCREMENT and LAST_NUMBER for the given table.
AUTHOR
Gilles Darold <gilles@darold.net>
COPYRIGHT
Copyright (c) 2001 Gilles Darold - All rights reserved.
This program is free software; you can redistribute it and/or modify it
under the same terms as Perl itself.
BUGS
This perl module is in the same state as my knowledge regarding
database, it can move and not be compatible with older version so I will
do my best to give you official support for Ora2Pg. Your volontee to
help construct it and your contribution are welcome.
SEE ALSO
the DBI manpage, the DBD::Oracle manpage
contrib/oracle/TODO 0 → 100644
View file @ 904ba3ff
- Extract sequences on tables. Seem to be difficult, can't find the way to link
a sequence with one or more column. So problably just dump and edit manually
- More precision in type conversion based on length (I've no good DB to do that)
- Extract triggers and internal function.
- Extract datas.
- SQL queries converter.
contrib/oracle/ora2pg.html
View file @ 904ba3ff
<HTML> <HTML>
<HEAD> <HEAD>
<TITLE>Ora2Pg - Oracle to PostgreSQL database schema converter</TITLE> <TITLE>Ora2Pg - Oracle to PostgreSQL database schema converter</TITLE>
<LINK REV="made" HREF="mailto:root@porky.devel.redhat.com"> <LINK REV="made" HREF="mailto:darold@localhost.localdomain">
</HEAD> </HEAD>
<BODY> <BODY>
<A NAME="__index__"></A>
<!-- INDEX BEGIN --> <!-- INDEX BEGIN -->
<UL> <UL>
<LI><A HREF="#NAME">NAME</A> <LI><A HREF="#name">NAME</A></LI>
<LI><A HREF="#SYNOPSIS">SYNOPSIS</A> <LI><A HREF="#synopsis">SYNOPSIS</A></LI>
<LI><A HREF="#DESCRIPTION">DESCRIPTION</A> <LI><A HREF="#description">DESCRIPTION</A></LI>
<LI><A HREF="#ABSTRACT">ABSTRACT</A> <LI><A HREF="#abstract">ABSTRACT</A></LI>
<LI><A HREF="#REQUIREMENT">REQUIREMENT</A> <LI><A HREF="#requirement">REQUIREMENT</A></LI>
<LI><A HREF="#PUBLIC_METHODS">PUBLIC METHODS</A> <LI><A HREF="#public methods">PUBLIC METHODS</A></LI>
<UL> <UL>
<LI><A HREF="#new_HASH_OPTIONS">new HASH_OPTIONS</A> <LI><A HREF="#new hash_options">new HASH_OPTIONS</A></LI>
<LI><A HREF="#export_sql_FILENAME">export_sql FILENAME</A> <LI><A HREF="#export_sql filename">export_sql FILENAME</A></LI>
</UL> </UL>
<LI><A HREF="#PUBLIC_METHODS">PUBLIC METHODS</A> <LI><A HREF="#public methods">PUBLIC METHODS</A></LI>
<UL> <UL>
<LI><A HREF="#_init_HASH_OPTIONS">_init HASH_OPTIONS</A> <LI><A HREF="#_init hash_options">_init HASH_OPTIONS</A></LI>
<LI><A HREF="#_tables">_tables</A> <LI><A HREF="#_tables">_tables</A></LI>
<LI><A HREF="#_get_sql_data">_get_sql_data</A> <LI><A HREF="#_views">_views</A></LI>
<LI><A HREF="#_sql_type_INTERNAL_TYPE_LENGTH">_sql_type INTERNAL_TYPE LENGTH</A> <LI><A HREF="#_get_sql_data">_get_sql_data</A></LI>
<LI><A HREF="#_column_info_TABLE">_column_info TABLE</A> <LI><A HREF="#_sql_type internal_type length">_sql_type INTERNAL_TYPE LENGTH</A></LI>
<LI><A HREF="#_primary_key_TABLE">_primary_key TABLE</A> <LI><A HREF="#_column_info table">_column_info TABLE</A></LI>
<LI><A HREF="#_unique_key_TABLE">_unique_key TABLE</A> <LI><A HREF="#_primary_key table">_primary_key TABLE</A></LI>
<LI><A HREF="#_foreign_key_TABLE">_foreign_key TABLE</A> <LI><A HREF="#_unique_key table">_unique_key TABLE</A></LI>
<LI><A HREF="#_get_privilege">_get_privilege </A> <LI><A HREF="#_foreign_key table">_foreign_key TABLE</A></LI>
<LI><A HREF="#_get_table_privilege table">_get_table_privilege TABLE</A></LI>
<LI><A HREF="#_get_roles">_get_roles</A></LI>
<LI><A HREF="#_get_indexes table">_get_indexes TABLE</A></LI>
<LI><A HREF="#_get_sequences table">_get_sequences TABLE</A></LI>
<LI><A HREF="#_get_views">_get_views</A></LI>
</UL> </UL>
<LI><A HREF="#AUTHOR">AUTHOR</A> <LI><A HREF="#author">AUTHOR</A></LI>
<LI><A HREF="#COPYRIGHT">COPYRIGHT</A> <LI><A HREF="#copyright">COPYRIGHT</A></LI>
<LI><A HREF="#BUGS">BUGS</A> <LI><A HREF="#bugs">BUGS</A></LI>
<LI><A HREF="#SEE_ALSO">SEE ALSO</A> <LI><A HREF="#see also">SEE ALSO</A></LI>
</UL> </UL>
<!-- INDEX END --> <!-- INDEX END -->
<HR> <HR>
<P> <P>
<H1><A NAME="NAME">NAME</A></H1> <H1><A NAME="name">NAME</A></H1>
<P> <P>Ora2Pg - Oracle to PostgreSQL database schema converter</P>
Ora2Pg - Oracle to PostgreSQL database schema converter
<P> <P>
<HR> <HR>
<H1><A NAME="SYNOPSIS">SYNOPSIS</A></H1> <H1><A NAME="synopsis">SYNOPSIS</A></H1>
<P> <PRE>
<PRE> BEGIN { BEGIN {
$ENV{ORACLE_HOME} = '/usr/local/oracle/oracle816'; $ENV{ORACLE_HOME} = '/usr/local/oracle/oracle816';
} }</PRE>
</PRE> <PRE>
<P> use strict;</PRE>
<PRE> use strict; <PRE>
</PRE> use Ora2Pg;</PRE>
<P> <PRE>
<PRE> use Ora2Pg; # Init the database connection
</PRE>
<P>
<PRE> # Init the database connection
my $dbsrc = 'dbi:Oracle:host=testdb.samse.fr;sid=TEST;port=1521'; my $dbsrc = 'dbi:Oracle:host=testdb.samse.fr;sid=TEST;port=1521';
my $dbuser = 'system'; my $dbuser = 'system';
my $dbpwd = 'manager'; my $dbpwd = 'manager';</PRE>
</PRE> <PRE>
<P> # Create an instance of the Ora2Pg perl module
<PRE> # Create an instance of the Ora2Pg perl module
my $schema = new Ora2Pg ( my $schema = new Ora2Pg (
datasource =&gt; $dbsrc, # Database DBD datasource datasource =&gt; $dbsrc, # Database DBD datasource
user =&gt; $dbuser, # Database user user =&gt; $dbuser, # Database user
password =&gt; $dbpwd, # Database password password =&gt; $dbpwd, # Database password
); );</PRE>
</PRE> <PRE>
<P> # Create the POSTGRESQL representation of all objects in the database
<PRE> # Create the POSTGRESQL representation of all objects in the database $schema-&gt;export_schema(&quot;output.sql&quot;);</PRE>
$schema-&gt;export_schema(&quot;output.sql&quot;); <PRE>
</PRE> exit(0);</PRE>
<P> <P>or if you only want to extract some tables:</P>
<PRE> exit(0); <PRE>
</PRE> # Create an instance of the Ora2Pg perl module
my @tables = ('tab1', 'tab2', 'tab3');
my $schema = new Ora2Pg (
datasource =&gt; $dbsrc, # Database DBD datasource
user =&gt; $dbuser, # Database user
password =&gt; $dbpwd, # Database password
tables =&gt; \@tables, # Tables to extract
debug =&gt; 1 # To show somethings when running
);</PRE>
<P>or if you only want to extract the 10 first tables:</P>
<PRE>
# Create an instance of the Ora2Pg perl module
my $schema = new Ora2Pg (
datasource =&gt; $dbsrc, # Database DBD datasource
user =&gt; $dbuser, # Database user
password =&gt; $dbpwd, # Database password
max =&gt; 10 # 10 first tables to extract
);</PRE>
<P>or if you only want to extract tables 10 to 20:</P>
<PRE>
# Create an instance of the Ora2Pg perl module
my $schema = new Ora2Pg (
datasource =&gt; $dbsrc, # Database DBD datasource
user =&gt; $dbuser, # Database user
password =&gt; $dbpwd, # Database password
min =&gt; 10 # Begin extraction at indice 10
max =&gt; 20 # End extraction at indice 20
);</PRE>
<P>To know at which indices table can be found during extraction use the option:</P>
<PRE>
showtableid =&gt; 1</PRE>
<P>To extract all views set the option type as follow:</P>
<PRE>
type =&gt; 'VIEW'</PRE>
<P>Default is table schema extraction</P>
<P> <P>
<HR> <HR>
<H1><A NAME="DESCRIPTION">DESCRIPTION</A></H1> <H1><A NAME="description">DESCRIPTION</A></H1>
<P> <P>Ora2Pg is a perl OO module used to export an Oracle database schema
Ora2Pg is a perl OO module used to export an Oracle database schema to a to a PostgreSQL compatible schema.</P>
PostgreSQL compatible schema. <P>It simply connect to your Oracle database, extract its structure and
generate a SQL script that you can load into your PostgreSQL database.</P>
<P> <P>I'm not a Oracle DBA so I don't really know something about its internal
It simply connect to your Oracle database, extract its structure and
generate a SQL script that you can load into your PostgreSQL database.
<P>
I'm not a Oracle DBA so I don't really know something about its internal
structure so you may find some incorrect things. Please tell me what is structure so you may find some incorrect things. Please tell me what is
wrong and what can be better. wrong and what can be better.</P>
<P>It currently only dump the database schema, with primary, unique and
<P> foreign keys. I've tried to excluded internal system tables but perhaps
It currently only dump the database schema, with primary, unique and not enougt, please let me know.</P>
foreign keys. I've tried to excluded internal system tables but perhaps not
enougt, please let me know.
<P>
<HR>
<H1><A NAME="ABSTRACT">ABSTRACT</A></H1>
<P>
The goal of the Ora2Pg perl module is to cover all part needed to export an
Oracle database to a PostgreSQL database without other thing that provide
the connection parameters to the Oracle database.
<P>
Features must include:
<P>
<PRE> - database schema export (done)
- grant export (done)
- predefined function/trigger export (todo)
- data export (todo)
- sql query converter (todo)
</PRE>
<P>
My knowledge regarding database is really poor especially for Oracle so
contribution is welcome.
<P> <P>
<HR> <HR>
<H1><A NAME="REQUIREMENT">REQUIREMENT</A></H1> <H1><A NAME="abstract">ABSTRACT</A></H1>
<P> <P>The goal of the Ora2Pg perl module is to cover all part needed to export
You just need the DBI and DBD::Oracle perl module to be installed an Oracle database to a PostgreSQL database without other thing that provide
the connection parameters to the Oracle database.</P>
<P>Features must include:</P>
<PRE>
- Database schema export, with unique, primary and foreign key.
- Grants/privileges export by user and group.
- Indexes and unique indexes export.
- Table or view selection (by name and max table) export.
- Predefined function/trigger export (todo)
- Data export (todo)
- Sql query converter (todo)</PRE>
<P>My knowledge regarding database is really poor especially for Oracle
so contribution is welcome.</P>
<P> <P>
<HR> <HR>
<H1><A NAME="PUBLIC_METHODS">PUBLIC METHODS</A></H1> <H1><A NAME="requirement">REQUIREMENT</A></H1>
<P>You just need the DBI and DBD::Oracle perl module to be installed</P>
<P> <P>
<HR> <HR>
<H2><A NAME="new_HASH_OPTIONS">new HASH_OPTIONS</A></H2> <H1><A NAME="public methods">PUBLIC METHODS</A></H1>
<P>
Creates a new Ora2Pg object.
<P>
Supported options are:
<P> <P>
<PRE> - datasource : DBD datasource (required) <H2><A NAME="new hash_options">new HASH_OPTIONS</A></H2>
<P>Creates a new Ora2Pg object.</P>
<P>Supported options are:</P>
<PRE>
- datasource : DBD datasource (required)
- user : DBD user (optional with public access) - user : DBD user (optional with public access)
- password : DBD password (optional with public access) - password : DBD password (optional with public access)
</PRE> - type : Type of data to extract, can be TABLE (default) or VIEW
<P> - debug : Print the current state of the parsing
Attempt that this list should grow a little more because all initialization - tables : Extract only the given tables (arrayref)
is done by this way. - showtableid : Display only the table indice during extraction
- min : Indice to begin extraction. Default to 0
- max : Indice to end extraction. Default to 0 mean no limits</PRE>
<P>Attempt that this list should grow a little more because all initialization is
done by this way.</P>
<P>
<H2><A NAME="export_sql filename">export_sql FILENAME</A></H2>
<P>Print SQL conversion output to a filename or
to STDOUT if no file is given.</P>
<P> <P>
<HR> <HR>
<H2><A NAME="export_sql_FILENAME">export_sql FILENAME</A></H2> <H1><A NAME="public methods">PUBLIC METHODS</A></H1>
<P> <P>
Print SQL conversion output to a filename or to STDOUT if no file is given. <H2><A NAME="_init hash_options">_init HASH_OPTIONS</A></H2>
<P>Initialize a Ora2Pg object instance with a connexion to the
Oracle database.</P>
<P> <P>
<HR>
<H1><A NAME="PUBLIC_METHODS">PUBLIC METHODS</A></H1>
<P>
<HR>
<H2><A NAME="_init_HASH_OPTIONS">_init HASH_OPTIONS</A></H2>
<P>
Initialize a Ora2Pg object instance with a connexion to the Oracle
database.
<P>
<HR>
<H2><A NAME="_tables">_tables</A></H2> <H2><A NAME="_tables">_tables</A></H2>
<P> <P>This function is used to retrieve all table information.</P>
This function is used to retrieve all table information. <P>Set the main hash of the database structure $self-&gt;{tables}.
Keys are the names of all tables retrieved from the current
<P> database. Each table information compose an array associated
Set the main hash of the database structure $self-&gt;{tables}. Keys are to the table_info key as array reference. In other way:</P>
the names of all tables retrieved from the current database. Each table <PRE>
information compose an array associated to the table_info key as array $self-&gt;{tables}{$class_name}{table_info} = [(OWNER,TYPE)];</PRE>
reference. In other way: <P>DBI TYPE can be TABLE, VIEW, SYSTEM TABLE, GLOBAL TEMPORARY, LOCAL TEMPORARY,
ALIAS, SYNONYM or a data source specific type identifier. This only extract
<P> TABLE type.</P>
<PRE> $self-&gt;{tables}{$class_name}{table_info} = [(OWNER,TYPE)]; <P>It also get the following informations in the DBI object to affect the
</PRE> main hash of the database structure :</P>
<P> <PRE>
TYPE Can be TABLE, VIEW, SYSTEM TABLE, GLOBAL TEMPORARY, LOCAL TEMPORARY, $self-&gt;{tables}{$class_name}{field_name} = $sth-&gt;{NAME};
ALIAS, SYNONYM or a data source specific type identifier. $self-&gt;{tables}{$class_name}{field_type} = $sth-&gt;{TYPE};</PRE>
<P>It also call these other private subroutine to affect the main hash
<P> of the database structure :</P>
It also get the following informations in the DBI object to affect the main <PRE>
hash of the database structure : @{$self-&gt;{tables}{$class_name}{column_info}} = &amp;_column_info($self, $class_name);
<P>
<PRE> $self-&gt;{tables}{$class_name}{field_name} = $sth-&gt;{NAME};
$self-&gt;{tables}{$class_name}{field_type} = $sth-&gt;{TYPE};
</PRE>
<P>
It also call these other private subroutine to affect the main hash of the
database structure :
<P>
<PRE> @{$self-&gt;{tables}{$class_name}{column_info}} = &amp;_column_info($self, $class_name);
@{$self-&gt;{tables}{$class_name}{primary_key}} = &amp;_primary_key($self, $class_name); @{$self-&gt;{tables}{$class_name}{primary_key}} = &amp;_primary_key($self, $class_name);
@{$self-&gt;{tables}{$class_name}{unique_key}} = &amp;_unique_key($self, $class_name); @{$self-&gt;{tables}{$class_name}{unique_key}} = &amp;_unique_key($self, $class_name);
@{$self-&gt;{tables}{$class_name}{foreign_key}} = &amp;_foreign_key($self, $class_name); @{$self-&gt;{tables}{$class_name}{foreign_key}} = &amp;_foreign_key($self, $class_name);</PRE>
</PRE> <P>
<H2><A NAME="_views">_views</A></H2>
<P>This function is used to retrieve all views information.</P>
<P>Set the main hash of the views definition $self-&gt;{views}.
Keys are the names of all views retrieved from the current
database values are the text definition of the views.</P>
<P>It then set the main hash as follow:</P>
<PRE>
# Definition of the view
$self-&gt;{views}{$table}{text} = $view_infos{$table};
# Grants defined on the views
$self-&gt;{views}{$table}{grants} = when I find how...</PRE>
<P> <P>
<HR>
<H2><A NAME="_get_sql_data">_get_sql_data</A></H2> <H2><A NAME="_get_sql_data">_get_sql_data</A></H2>
<P> <P>Returns a string containing the entire SQL Schema definition compatible with PostgreSQL</P>
Returns a string containing the entire SQL Schema definition compatible <P>
with PostgreSQL <H2><A NAME="_sql_type internal_type length">_sql_type INTERNAL_TYPE LENGTH</A></H2>
<P>This function return the PostgreSQL datatype corresponding to the
Oracle internal type.</P>
<P>
<H2><A NAME="_column_info table">_column_info TABLE</A></H2>
<P>This function implements a Oracle-native column information.</P>
<P>Return a list of array reference containing the following informations
for each column the given a table</P>
<P>[(
column name,
column type,
column length,
nullable column,
default value
)]</P>
<P>
<H2><A NAME="_primary_key table">_primary_key TABLE</A></H2>
<P>This function implements a Oracle-native primary key column
information.</P>
<P>Return a list of all column name defined as primary key
for the given table.</P>
<P>
<H2><A NAME="_unique_key table">_unique_key TABLE</A></H2>
<P>This function implements a Oracle-native unique key column
information.</P>
<P>Return a list of all column name defined as unique key
for the given table.</P>
<P>
<H2><A NAME="_foreign_key table">_foreign_key TABLE</A></H2>
<P>This function implements a Oracle-native foreign key reference
information.</P>
<P>Return a list of hash of hash of array reference. Ouuf! Nothing very difficult.
The first hash is composed of all foreign key name. The second hash just have
two key known as 'local' and remote' corresponding to the local table where the
foreign key is defined and the remote table where the key refer.</P>
<P>The foreign key name is composed as follow:</P>
<PRE>
'local_table_name-&gt;remote_table_name'</PRE>
<P>Foreign key data consist in two array representing at the same indice the local
field and the remote field where the first one refer to the second.
Just like this:</P>
<PRE>
@{$link{$fkey_name}{local}} = @local_columns;
@{$link{$fkey_name}{remote}} = @remote_columns;</PRE>
<P>
<H2><A NAME="_get_table_privilege table">_get_table_privilege TABLE</A></H2>
<P>This function implements a Oracle-native table grants
information.</P>
<P>Return a hash of array of all users and their grants on the
given table.</P>
<P>
<H2><A NAME="_get_roles">_get_roles</A></H2>
<P>This function implements a Oracle-native roles/users
information.</P>
<P>Return a hash of all groups (roles) as an array of associated users.</P>
<P>
<H2><A NAME="_get_indexes table">_get_indexes TABLE</A></H2>
<P>This function implements a Oracle-native indexes
information.</P>
<P>Return an array of all indexes name which are not primary keys
for the given table.</P>
<P>Note: Indexes name must be created like this tablename_fieldname
else they will not be retrieved or if tablename false in the output
fieldname.</P>
<P>
<H2><A NAME="_get_sequences table">_get_sequences TABLE</A></H2>
<P>This function implements a Oracle-native sequence
information.</P>
<P>Return a hash of array of sequence name with MIN_VALUE, MAX_VALUE,
INCREMENT and LAST_NUMBER for the given table.</P>
<P>Not working yet.</P>
<P>
<H2><A NAME="_get_views">_get_views</A></H2>
<P>This function implements a Oracle-native views information.</P>
<P>Return a hash of array of sequence name with MIN_VALUE, MAX_VALUE,
INCREMENT and LAST_NUMBER for the given table.</P>
<P> <P>
<HR> <HR>
<H2><A NAME="_sql_type_INTERNAL_TYPE_LENGTH">_sql_type INTERNAL_TYPE LENGTH</A></H2> <H1><A NAME="author">AUTHOR</A></H1>
<P> <P>Gilles Darold &lt;<A HREF="mailto:gilles@darold.net">gilles@darold.net</A>&gt;</P>
This function return the PostgreSQL datatype corresponding to the Oracle
internal type.
<P> <P>
<HR> <HR>
<H2><A NAME="_column_info_TABLE">_column_info TABLE</A></H2> <H1><A NAME="copyright">COPYRIGHT</A></H1>
<P> <P>Copyright (c) 2001 Gilles Darold - All rights reserved.</P>
This function implements a Oracle-native column information. <P>This program is free software; you can redistribute it and/or modify it under
the same terms as Perl itself.</P>
<P>
Return a list of array reference containing the following informations for
each column the given a table
<P>
[( column name, column type, column length, nullable column, default value
)]
<P> <P>
<HR> <HR>
<H2><A NAME="_primary_key_TABLE">_primary_key TABLE</A></H2> <H1><A NAME="bugs">BUGS</A></H1>
<P> <P>This perl module is in the same state as my knowledge regarding database,
This function implements a Oracle-native primary key column information.
<P>
Return a list of all column name defined as primary key for the given
table.
<P>
<HR>
<H2><A NAME="_unique_key_TABLE">_unique_key TABLE</A></H2>
<P>
This function implements a Oracle-native unique key column information.
<P>
Return a list of all column name defined as unique key for the given table.
<P>
<HR>
<H2><A NAME="_foreign_key_TABLE">_foreign_key TABLE</A></H2>
<P>
This function implements a Oracle-native foreign key reference information.
<P>
Return a list of hash of hash of array reference. Ouuf! Nothing very
difficult. The first hash is composed of all foreign key name. The second
hash just have two key known as 'local' and remote' corresponding to the
local table where the foreign key is defined and the remote table where the
key refer.
<P>
The foreign key name is composed as follow:
<P>
<PRE> 'local_table_name-&gt;remote_table_name'
</PRE>
<P>
Foreign key data consist in two array representing at the same indice the
local field and the remote field where the first one refer to the second.
Just like this:
<P>
<PRE> @{$link{$fkey_name}{local}} = @local_columns;
@{$link{$fkey_name}{remote}} = @remote_columns;
</PRE>
<P>
<HR>
<H2><A NAME="_get_privilege">_get_privilege</A></H2>
<P>
This function implements a Oracle-native tables grants information.
<P>
Return a hash of all groups (roles) with associated users and a hash of
arrays of all grants on related tables.
<P>
<HR>
<H1><A NAME="AUTHOR">AUTHOR</A></H1>
<P>
Gilles Darold &lt;<A
HREF="mailto:gilles@darold.net">gilles@darold.net</A>&gt;
<P>
<HR>
<H1><A NAME="COPYRIGHT">COPYRIGHT</A></H1>
<P>
Copyright (c) 2001 Gilles Darold - All rights reserved.
<P>
This program is free software; you can redistribute it and/or modify it
under the same terms as Perl itself.
<P>
<HR>
<H1><A NAME="BUGS">BUGS</A></H1>
<P>
This perl module is in the same state as my knowledge regarding database,
it can move and not be compatible with older version so I will do my best it can move and not be compatible with older version so I will do my best
to give you official support for Ora2Pg. Your volontee to help construct it to give you official support for Ora2Pg. Your volontee to help construct
and your contribution are welcome. it and your contribution are welcome.</P>
<P> <P>
<HR> <HR>
<H1><A NAME="SEE_ALSO">SEE ALSO</A></H1> <H1><A NAME="see also">SEE ALSO</A></H1>
<P> <P><EM>DBI</EM>, <A HREF="/DBD/Oracle.html">the DBD::Oracle manpage</A></P>
<EM>DBI</EM>, <A HREF="/DBD/Oracle.html">DBD::Oracle</A>
</BODY> </BODY>
......
contrib/oracle/ora2pg.pl
View file @ 904ba3ff
...@@ -20,7 +20,7 @@ use strict; ...@@ -20,7 +20,7 @@ use strict;
use Ora2Pg; use Ora2Pg;
# Initialyze the database connection # Initialyze the database connection
my $dbsrc = 'dbi:Oracle:host=aliciadb.samse.fr;sid=ALIC;port=1521'; my $dbsrc = 'dbi:Oracle:host=test.mydomain.com;sid=TEST;port=1521';
my $dbuser = 'system'; my $dbuser = 'system';
my $dbpwd = 'manager'; my $dbpwd = 'manager';
...@@ -29,6 +29,12 @@ my $schema = new Ora2Pg ( ...@@ -29,6 +29,12 @@ my $schema = new Ora2Pg (
datasource => $dbsrc, # Database DBD datasource datasource => $dbsrc, # Database DBD datasource
user => $dbuser, # Database user user => $dbuser, # Database user
password => $dbpwd, # Database password password => $dbpwd, # Database password
debug => 1, # Verbose mode
# type => 'VIEW', # Extract views
# tables => [('MY_TABLE1','MY_TABLE2')], # Extract only these table
# showtableid => 1, # Display only table indice during extraction
# min => 1, # Extract begin at indice 1
# max => 10 # Extract ended at indice 10
); );
# Create the POSTGRESQL representation of all objects in the database # Create the POSTGRESQL representation of all objects in the database
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment