AW: [Rdfapi-php-interest] RAP DB

Uppps, 1.5 MTriple in RAP, great :-)

I guess S=F6ren will be interested. He was playing around with similar =
size N3
files for his POWL project based on RAP.

Chris



--=20
Chris Bizer
Freie Universit=E4t Berlin
Phone: +49 30 838 54057
Mail: ch...@bi...
Web: www.bizer.de

-----Urspr=FCngliche Nachricht-----
Von: rdf...@li...
[mailto:rdf...@li...] Im Auftrag von
Gunnar AAstrand Grimnes
Gesendet: Dienstag, 1. Februar 2005 15:33
An: rdf...@li...
Betreff: [Rdfapi-php-interest] RAP DB

Hi all,

Good idea to setup a mailing-list chris!

This might be a bit early, as there might not be anyone else than me and =

chris subscribed yet, but others can always check the archive.

Here the other day I needed to put a 120mb rdf/xml file into a RAP DB, I =

tried using the db-tool and uploading it, but on my P4 with 1gb of=20
memory it used 1.8gb of memory, froze the whole machine and was still=20
showing no sign of connecting to the DB after 30 minutes, so I stopped =
it.

Instead admitted that maybe PHP isn't right for everything and wrote a=20
java program to insert into mysql DB in RAPDB format. The program is=20
attached, and currently requires jena2, Java getopt=20
(http://www.urbanophile.com/arenn/hacking/download.html) and probably=20
java 1.5.

With this you can for example do:

java RAPDBInsert -m "http://example.org" -h trogon -u ggrimnes -p ****=20
-d rdf ~/public_html/foaf.rdf

This worked like a dream, and I've now got a RAP DB with 1579160 (1.5M!) =

triples. Normal operations like $model->find($res,$DC_title,null) are=20
quick, but anything that requires getting the whole model into memory=20
(f.x. regex finds) breaks everything. Even getting the size of the model =

takes ~=3D15s, but with some care it's fully usable!

Anyway, hope this might be useful to someone else.

- Gunnar


--=20
Gunnar AAstrand Grimnes
-----------------------
Room 312, Computing Science Dept.
University of Aberdeen
Aberdeen
AB24 3UE

Mobile: (+44) (0) 7950 251379

Email: ggr...@cs...
WWW: http://www.csd.abdn.ac.uk/~ggrimnes