|
Home > Archive > Apache Directory Project > June 2007 > [ApacheDS] [Partition] Search Engine - Backend interfacing points
You are viewing an archived Text-only version of the thread.
To view this thread in it's original format and/or if you want to reply to
this thread please [click here]
| Author |
[ApacheDS] [Partition] Search Engine - Backend interfacing points
|
|
| Ersin Er 2007-06-21, 1:11 pm |
| Hi,
The SearchEngine and related classes interface with the actual entry
storage at some points. What I am looking for is methods such as
org.apache.directory.server.core.partition.impl.btree.BTreePartition.lookup(
Long id ). It's one implementation is
org.apache.directory.server.core.partition.impl.btree.jdbm.JdbmPartition.lookup(
Long id ). W
We can intercept such methods and modify the returning entries from
physical partitions. I have made a simple test but it seems there are
other parts of the server which makes such kind of entry retrieval.
Any ideas?
--
Ersin Er
R.A. and Ph.D Student at the Dept. of Computer Eng. in Hacettepe University
http://www.cs.hacettepe.edu.tr
Committer and PMC Member of The Apache Directory Project
http://directory.apache.org
| |
| Ersin Er 2007-06-21, 1:11 pm |
| BTW, what I am trying to do is partially explained here:
http://directory.apache.org/apached...-on-demand.html
On 6/21/07, Ersin Er <ersin.er-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> wrote:
> Hi,
>
> The SearchEngine and related classes interface with the actual entry
> storage at some points. What I am looking for is methods such as
> org.apache.directory.server.core.partition.impl.btree.BTreePartition.lookup(
> Long id ). It's one implementation is
> org.apache.directory.server.core.partition.impl.btree.jdbm.JdbmPartition.lookup(
> Long id ). W
>
> We can intercept such methods and modify the returning entries from
> physical partitions. I have made a simple test but it seems there are
> other parts of the server which makes such kind of entry retrieval.
>
> Any ideas?
>
> --
> Ersin Er
>
> R.A. and Ph.D Student at the Dept. of Computer Eng. in Hacettepe University
> http://www.cs.hacettepe.edu.tr
>
> Committer and PMC Member of The Apache Directory Project
> http://directory.apache.org
>
--
Ersin Er
R.A. and Ph.D Student at the Dept. of Computer Eng. in Hacettepe University
http://www.cs.hacettepe.edu.tr
Committer and PMC Member of The Apache Directory Project
http://directory.apache.org
| |
| Emmanuel Lecharny 2007-06-21, 1:11 pm |
| Ersin,
we have had a kind of discussion with Alex (one night, in front of a
dozen of beers, rebuilding a better planet), where we decided it would
definitively be a good idea to have this low level layer where we can
manage a kind of entry cache instead of managing many different caches
everywhere. The question we didn't answered is : should this cache be
cross partition or per partition ?
As far as I remember, it was a cross-partition cache, with a kind of
managed cache partitioning :
like 'ou=3Dsystem' partition will get 40% of the cache, and
'dc=3Dexample,dc=3Dcom' will get 60%, for instance.
last, not least, we thought that some partition or some entries might
be loaded but not discardable from the cache (for instance, the admin
user).
This is somehow complex, and we need to dig the ideas a little bit further.=
...
Emmaanuel
On 6/21/07, Ersin Er <ersin.er-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> wrote:
> BTW, what I am trying to do is partially explained here:
>
> http://directory.apache.org/apached...-on-demand.html
>
> On 6/21/07, Ersin Er <ersin.er-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> wrote:
okup([vbcol=seagreen]
n.lookup([vbcol=seagreen]
sity[vbcol=seagreen]
>
>
> --
> Ersin Er
>
> R.A. and Ph.D Student at the Dept. of Computer Eng. in Hacettepe Universi=
ty
> http://www.cs.hacettepe.edu.tr
>
> Committer and PMC Member of The Apache Directory Project
> http://directory.apache.org
>
--=20
Regards,
Cordialement,
Emmanuel L=E9charny
www.iktek.com
| |
| Alex Karasulu 2007-06-23, 7:11 am |
| OK guys I want to respond to this correctly and after considering all these
links/ideas we have but I'm overloaded. Will try to hit this thread in a
while
today after processing all my email.
Stay tuned  .
Alex
On 6/21/07, Emmanuel Lecharny <elecharny-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> wrote:
>
> Ersin,
>
> we have had a kind of discussion with Alex (one night, in front of a
> dozen of beers, rebuilding a better planet), where we decided it would
> definitively be a good idea to have this low level layer where we can
> manage a kind of entry cache instead of managing many different caches
> everywhere. The question we didn't answered is : should this cache be
> cross partition or per partition ?
>
> As far as I remember, it was a cross-partition cache, with a kind of
> managed cache partitioning :
> like 'ou=system' partition will get 40% of the cache, and
> 'dc=example,dc=com' will get 60%, for instance.
> last, not least, we thought that some partition or some entries might
> be loaded but not discardable from the cache (for instance, the admin
> user).
>
> This is somehow complex, and we need to dig the ideas a little bit
> further...
>
> Emmaanuel
>
> On 6/21/07, Ersin Er <ersin.er-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> wrote:
> org.apache.directory.server.core.partition.impl.btree.BTreePartition.lookup
> (
> org.apache.directory.server.core.partition.impl.btree.jdbm.JdbmPartition.lookup
> (
> university
> university
>
>
> --
> Regards,
> Cordialement,
> Emmanuel Lécharny
> www.iktek.com
>
| |
| Ersin Er 2007-06-27, 7:11 pm |
| SnVzdCBhIHJlbWluZGVyLgoKT24gNi8yMy8wNywg
QWxleCBLYXJhc3VsdSA8YWthcmFzdWx1QGFw
YWNoZS5vcmc+IHdyb3RlOgo+IE9LIGd1eXMgSSB3
YW50IHRvIHJlc3BvbmQgdG8gdGhpcyBjb3Jy
ZWN0bHkgYW5kIGFmdGVyIGNvbnNpZGVyaW5nIGFs
bCB0aGVzZQo+IGxpbmtzL2lkZWFzIHdlIGhh
dmUgYnV0IEknbSBvdmVybG9hZGVkLiAgV2lsbCB0
cnkgdG8gaGl0IHRoaXMgdGhyZWFkIGluIGEK
PiB3aGlsZQo+IHRvZGF5IGFmdGVyIHByb2Nlc3Np
bmcgYWxsIG15IGVtYWlsLgo+Cj4gU3RheSB0
dW5lZCA6KS4KPgo+IEFsZXgKPgo+Cj4gT24gNi8y
MS8wNywgRW1tYW51ZWwgTGVjaGFybnkgPGVs
ZWNoYXJueUBnbWFpbC5jb20+IHdyb3RlOgo+ID4g
RXJzaW4sCj4gPgo+ID4gd2UgaGF2ZSBoYWQg
YSBraW5kIG9mIGRpc2N1c3Npb24gd2l0aCBBbGV4
IChvbmUgbmlnaHQsIGluIGZyb250IG9mIGEK
PiA+IGRvemVuIG9mIGJlZXJzLCByZWJ1aWxkaW5n
IGEgYmV0dGVyIHBsYW5ldCksIHdoZXJlIHdl
IGRlY2lkZWQgaXQgd291bGQKPiA+IGRlZmluaXRp
dmVseSBiZSBhIGdvb2QgaWRlYSB0byBoYXZl
IHRoaXMgbG93IGxldmVsIGxheWVyIHdoZXJlIHdl
IGNhbgo+ID4gbWFuYWdlIGEga2luZCBvZiBl
bnRyeSBjYWNoZSBpbnN0ZWFkIG9mIG1hbmFnaW5n
IG1hbnkgZGlmZmVyZW50IGNhY2hlcwo+ID4g
ZXZlcnl3aGVyZS4gVGhlIHF1ZXN0aW9uIHdlIGRp
ZG4ndCBhbnN3ZXJlZCBpcyA6IHNob3VsZCB0
aGlzIGNhY2hlIGJlCj4gPiBjcm9zcyBwYXJ0aXRp
b24gb3IgcGVyIHBhcnRpdGlvbiA/Cj4gPgo+
ID4gQXMgZmFyIGFzIEkgcmVtZW1iZXIsIGl0IHdh
cyBhIGNyb3NzLXBhcnRpdGlvbiBjYWNoZSwg
d2l0aCBhIGtpbmQgb2YKPiA+IG1hbmFnZWQgY2Fj
aGUgcGFydGl0aW9uaW5nIDoKPiA+IGxpa2Ug
J291PXN5c3RlbScgcGFydGl0aW9uIHdpbGwgZ2V0
IDQwJSBvZiB0aGUgY2FjaGUsIGFuZAo+ID4g
J2RjPWV4YW1wbGUsZGM9Y29tJyB3aWxsIGdldCA2
MCUsIGZvciBpbnN0YW5jZS4KPiA+IGxhc3Qs
IG5vdCBsZWFzdCwgd2UgdGhvdWdodCB0aGF0IHNv
bWUgcGFydGl0aW9uIG9yIHNvbWUgZW50cmll
cyAgbWlnaHQKPiA+IGJlIGxvYWRlZCBidXQgbm90
IGRpc2NhcmRhYmxlIGZyb20gdGhlIGNhY2hl
IChmb3IgaW5zdGFuY2UsIHRoZSBhZG1pbgo+ID4g
dXNlcikuCj4gPgo+ID4gVGhpcyBpcyBzb21l
aG93IGNvbXBsZXgsIGFuZCB3ZSBuZWVkIHRvIGRp
ZyB0aGUgaWRlYXMgYSBsaXR0bGUgYml0Cj4g
ZnVydGhlci4uLgo+ID4KPiA+IEVtbWFhbnVlbAo+
ID4KPiA+IE9uIDYvMjEvMDcsIEVyc2luIEVy
IDwgZXJzaW4uZXJAZ21haWwuY29tPiB3cm90ZToK
PiA+ID4gQlRXLCB3aGF0IEkgYW0gdHJ5aW5n
IHRvIGRvIGlzIHBhcnRpYWxseSBleHBsYWluZWQg
aGVyZToKPiA+ID4KPiA+ID4KPiBodHRwOi8v
ZGlyZWN0b3J5LmFwYWNoZS5vcmcvYXBhY2hlZHMv
MS41L2F0dHJpYnV0ZXMtb24tZGVtYW5kLmh0
bWwKPiA+ID4KPiA+ID4gT24gNi8yMS8wNywgRXJz
aW4gRXIgPGVyc2luLmVyQGdtYWlsLmNvbT4g
d3JvdGU6Cj4gPiA+ID4gSGksCj4gPiA+ID4KPiA+
ID4gPiBUaGUgU2VhcmNoRW5naW5lIGFuZCBy
ZWxhdGVkIGNsYXNzZXMgaW50ZXJmYWNlIHdpdGgg
dGhlIGFjdHVhbCBlbnRyeQo+ID4gPiA+IHN0
b3JhZ2UgYXQgc29tZSBwb2ludHMuICBXaGF0IEkg
YW0gbG9va2luZyBmb3IgaXMgbWV0aG9kcyBz
dWNoIGFzCj4gPiA+ID4KPiBvcmcuYXBhY2hlLmRp
cmVjdG9yeS5zZXJ2ZXIuY29yZS5wYXJ0aXRp
b24uaW1wbC5idHJlZS5CVHJlZVBhcnRpdGlvbi5s
b29rdXAoCj4gPiA+ID4gTG9uZyBpZCApLiBJ
dCdzIG9uZSBpbXBsZW1lbnRhdGlvbiBpcwo+ID4g
PiA+Cj4gb3JnLmFwYWNoZS5kaXJlY3Rvcnku
c2VydmVyLmNvcmUucGFydGl0aW9uLmltcGwuYnRy
ZWUuamRibS5KZGJtUGFydGl0aW9uLmxvb2t1
cCgKPiA+ID4gPiBMb25nIGlkICkuIFcKPiA+ID4g
Pgo+ID4gPiA+IFdlIGNhbiBpbnRlcmNlcHQg
c3VjaCBtZXRob2RzIGFuZCBtb2RpZnkgdGhlIHJl
dHVybmluZyBlbnRyaWVzIGZyb20KPiA+ID4g
PiBwaHlzaWNhbCBwYXJ0aXRpb25zLiBJIGhhdmUg
bWFkZSBhIHNpbXBsZSB0ZXN0IGJ1dCBpdCBz
ZWVtcyB0aGVyZSBhcmUKPiA+ID4gPiBvdGhlciBw
YXJ0cyBvZiB0aGUgc2VydmVyIHdoaWNoIG1h
a2VzIHN1Y2gga2luZCBvZiBlbnRyeSByZXRyaWV2
YWwuCj4gPiA+ID4KPiA+ID4gPiBBbnkgaWRl
YXM/ Cj4gPiA+ID4KPiA+ID4gPiAtLQo+ID4gPiA+IEVy
c2luIEVyCj4gPiA+ID4KPiA+ID4gPiBS
LkEuIGFuZCBQaC5EIFN0dWRlbnQgYXQgdGhlIERl
cHQuIG9mIENvbXB1dGVyIEVuZy4gaW4gSGFj
ZXR0ZXBlCj4gVW5pdmVyc2l0eQo+ID4gPiA+IGh0
dHA6Ly93d3cuY3MuaGFjZXR0ZXBlLmVkdS50
cgo+ID4gPiA+Cj4gPiA+ID4gQ29tbWl0dGVyIGFu
ZCBQTUMgTWVtYmVyIG9mIFRoZSBBcGFjaGUg
RGlyZWN0b3J5IFByb2plY3QKPiA+ID4gPiBodHRw
Oi8vZGlyZWN0b3J5LmFwYWNoZS5vcmcKPiA+
ID4gPgo+ID4gPgo+ID4gPgo+ID4gPiAtLQo+ID4g
PiBFcnNpbiBFcgo+ID4gPgo+ID4gPiBSLkEu
IGFuZCBQaC5EIFN0dWRlbnQgYXQgdGhlIERlcHQu
IG9mIENvbXB1dGVyIEVuZy4gaW4gSGFjZXR0
ZXBlCj4gVW5pdmVyc2l0eQo+ID4gPiBodHRwOi8v
d3d3LmNzLmhhY2V0dGVwZS5lZHUudHIKPiA+
ID4KPiA+ID4gQ29tbWl0dGVyIGFuZCBQTUMgTWVt
YmVyIG9mIFRoZSBBcGFjaGUgRGlyZWN0b3J5
IFByb2plY3QKPiA+ID4gaHR0cDovL2RpcmVjdG9y
eS5hcGFjaGUub3JnCj4gPiA+Cj4gPgo+ID4K
PiA+IC0tCj4gPiBSZWdhcmRzLAo+ID4gQ29yZGlh
bGVtZW50LAo+ID4gRW1tYW51ZWwgTMOpY2hh
cm55Cj4gPiB3d3cuaWt0ZWsuY29tCj4gPgo+Cj4K
CgotLSAKRXJzaW4gRXIKClIuQS4gYW5kIFBo
LkQgU3R1ZGVudCBhdCB0aGUgRGVwdC4gb2YgQ29t
cHV0ZXIgRW5nLiBpbiBIYWNldHRlcGUgVW5p
dmVyc2l0eQpodHRwOi8vd3d3LmNzLmhhY2V0dGVw
ZS5lZHUudHIKCkNvbW1pdHRlciBhbmQgUE1D
IE1lbWJlciBvZiBUaGUgQXBhY2hlIERpcmVjdG9y
eSBQcm9qZWN0Cmh0dHA6Ly9kaXJlY3Rvcnku
YXBhY2hlLm9yZwo=
|
|
|
|
|