raptordb Issue Tracker Rss Feed

Created Issue: Not on Nuget [5]

seer_tenedos — Thu, 08 Nov 2012 08:32:09 GMT

This seems like such a great database lib that it really should be on Nuget!

Closed Issue: Query error when using non-simple variable [4]

MGholam — Tue, 25 Sep 2012 19:34:16 GMT

When using a LINQ query such as raptor.Query(..., o => o.MyValue == someObject.SomeProperty); it crashes with "Object must implement IConvertible" near Indexes.cs:31. It seems that it tries to evaluate the object instead of retrieving the member.

The following patch seems to resolve that issue. It probably doesn't cover all cases, but it's a step in the right direction I think.

RaptorDB/Views/LINQQuery.cs in VisitMember:
@@ -90,11 +90,17 @@
BindingFlags.Instance |
BindingFlags.Static, null, c.Value, null);
_stack.Push(x);
- }
- if (m.Expression != null && m.Expression.NodeType == ExpressionType.Parameter)
- {
- _stack.Push(m.Member.Name);
- return e;
+ }
+ if (m.Expression != null)
+ {
+ if (m.Expression.NodeType == ExpressionType.Parameter)
+ _stack.Push(m.Member.Name);
+ if (m.Expression.NodeType == ExpressionType.MemberAccess)
+ {
+ Type t = m.Expression.Type;
+ var val = t.InvokeMember(m.Member.Name, BindingFlags.GetProperty, null, _stack.Pop(), null);
+ _stack.Push(val);
+ }
}
return e;
}

I'm using Mercurial, so you might have to patch manually.

Commented Issue: Query error when using non-simple variable [4]

MGholam — Tue, 14 Aug 2012 13:17:01 GMT

Commented Issue: Query error when using non-simple variable [4]

jdluzen — Tue, 14 Aug 2012 12:57:30 GMT

Commented Issue: Query error when using non-simple variable [4]

jdluzen — Tue, 14 Aug 2012 12:53:56 GMT

Commented Issue: Query error when using non-simple variable [4]

MGholam — Tue, 14 Aug 2012 08:20:19 GMT

Commented Issue: Probable I/O race condition detected while copying memory [3]

MGholam — Tue, 14 Aug 2012 08:19:04 GMT

I'm using raptordb-8cae451eb90e, but this error still occurs when I insert more records into a database of 500,000 records:

A Task's exception(s) were not observed either by Waiting on the Task or accessing its Exception property. As a result, the unobserved exception was rethrown by the finalizer thread.

Probable I/O race condition detected while copying memory. The I/O package is not thread safe by default. In multithreaded applications, a stream must be accessed in a thread-safe way, such as a thread-safe wrapper returned by TextReader's or TextWriter's Synchronized methods. This also applies to classes like StreamWriter and StreamReader.

at System.Buffer.InternalBlockCopy(Array src, Int32 srcOffsetBytes, Array dst, Int32 dstOffsetBytes, Int32 byteCount)
at System.IO.FileStream.Read(Byte[] array, Int32 offset, Int32 count)
at RaptorDB.BitmapIndex.internalGetBitmap(Int32 recno) in D:\RaptorDB\RaptorDB_doc_v1.6\RaptorDB\Indexes\BitmapIndex.cs:line 194
at RaptorDB.MGIndex`1.doEqualOp(RDBExpression exp, T key) in D:\RaptorDB\RaptorDB_doc_v1.6\RaptorDB\Indexes\MGIndex.cs:line 338
at RaptorDB.MGIndex`1.Query(RDBExpression exp, T from) in D:\RaptorDB\RaptorDB_doc_v1.6\RaptorDB\Indexes\MGIndex.cs:line 113
at RaptorDB.TypeIndexes`1.Query(RDBExpression ex, Object from) in D:\RaptorDB\RaptorDB_doc_v1.6\RaptorDB\Indexes\Indexes.cs:line 34
at RaptorDB.Views.ViewHandler.SaveAndIndex(Dictionary`2 rows) in D:\RaptorDB\RaptorDB_doc_v1.6\RaptorDB\Views\ViewHandler.cs:line 148
at RaptorDB.Views.ViewHandler.Insert[T](Guid guid, T doc) in D:\RaptorDB\RaptorDB_doc_v1.6\RaptorDB\Views\ViewHandler.cs:line 140
at RaptorDB.Views.ViewManager.<>c__DisplayClass2`1.<Insert>b__0() in D:\RaptorDB\RaptorDB_doc_v1.6\RaptorDB\Views\ViewManager.cs:line 111
at System.Threading.Tasks.Task.InnerInvoke()
at System.Threading.Tasks.Task.Execute()

Comments: Checkout v1.8.2

Commented Issue: Query error when using non-simple variable [4]

MGholam — Tue, 14 Aug 2012 03:50:28 GMT

Created Issue: Query error when using non-simple variable [4]

jdluzen — Tue, 14 Aug 2012 03:08:00 GMT

Created Issue: Probable I/O race condition detected while copying memory [3]

08520302 — Tue, 14 Aug 2012 02:08:56 GMT

Edited Issue: Page read error header invalid, number = 1 [2]

jdluzen — Thu, 09 Aug 2012 20:37:33 GMT

When inserting a simple new document, at random times I get:

System.AggregateException: One or more errors occurred. ---> System.Exception: Page read error header invalid, number = 1
at RaptorDB.IndexFile`1.LoadPageFromPageNumber(Int32 number) in <path>RaptorDB\Indexes\IndexFile.cs:line 329
at RaptorDB.MGIndex`1.LoadPage(T key, PageInfo& pageinfo) in <path>RaptorDB\Indexes\MGIndex.cs:line 413
at RaptorDB.MGIndex`1.doEqualOp(RDBExpression exp, T key) in <path>RaptorDB\Indexes\MGIndex.cs:line 328
at RaptorDB.MGIndex`1.Query(RDBExpression exp, T from) in <path>RaptorDB\Indexes\MGIndex.cs:line 113
at RaptorDB.TypeIndexes`1.Query(RDBExpression ex, Object from) in <path>RaptorDB\Indexes\Indexes.cs:line 34
at RaptorDB.Views.ViewHandler.SaveAndIndex(Dictionary`2 rows) in <path>RaptorDB\Views\ViewHandler.cs:line 149
at RaptorDB.Views.ViewHandler.Insert[T](Guid guid, T doc) in <path>RaptorDB\Views\ViewHandler.cs:line 141
at RaptorDB.Views.ViewManager.<>c__DisplayClass2`1.<Insert>b__0() in <path>RaptorDB\Views\ViewManager.cs:line 126
at System.Threading.Tasks.Task.InnerInvoke()
at System.Threading.Tasks.Task.Execute()
--- End of inner exception stack trace ---
at System.Threading.Tasks.Task.WaitAll(Task[] tasks, Int32 millisecondsTimeout, CancellationToken cancellationToken)
at RaptorDB.Views.TaskQueue.Shutdown() in <path>RaptorDB\Views\TaskQueue.cs:line 64
at RaptorDB.Views.ViewManager.ShutDown() in <path>RaptorDB\Views\ViewManager.cs:line 216
at RaptorDB.RaptorDB.Shutdown() in <path>RaptorDB\RaptorDB.cs:line 294
at RaptorDbTest.Program.Main(String[] args) in <path>RaptorDbTest\RaptorDbTest\Program.cs:line 36
---> (Inner Exception #0) System.Exception: Page read error header invalid, number = 1
at RaptorDB.IndexFile`1.LoadPageFromPageNumber(Int32 number) in <path>RaptorDB\Indexes\IndexFile.cs:line 329
at RaptorDB.MGIndex`1.LoadPage(T key, PageInfo& pageinfo) in <path>RaptorDB\Indexes\MGIndex.cs:line 413
at RaptorDB.MGIndex`1.doEqualOp(RDBExpression exp, T key) in <path>RaptorDB\Indexes\MGIndex.cs:line 328
at RaptorDB.MGIndex`1.Query(RDBExpression exp, T from) in <path>RaptorDB\Indexes\MGIndex.cs:line 113
at RaptorDB.TypeIndexes`1.Query(RDBExpression ex, Object from) in <path>RaptorDB\Indexes\Indexes.cs:line 34
at RaptorDB.Views.ViewHandler.SaveAndIndex(Dictionary`2 rows) in <path>RaptorDB\Views\ViewHandler.cs:line 149
at RaptorDB.Views.ViewHandler.Insert[T](Guid guid, T doc) in <path>RaptorDB\Views\ViewHandler.cs:line 141
at RaptorDB.Views.ViewManager.<>c__DisplayClass2`1.<Insert>b__0() in <path>RaptorDB\Views\ViewManager.cs:line 126
at System.Threading.Tasks.Task.InnerInvoke()
at System.Threading.Tasks.Task.Execute()<---

It seems that it is a timing issue, as I cannot reproduce it in the debugger. IndexFile.cs's line numbers might be off slightly, as I edited it to include debugging output: b[0] through b[3] appear to all be 0, and so they do not match the magic numbers of _BlockHeader (PAGE).

Created Issue: Page read error header invalid, number = 1 [2]

jdluzen — Thu, 09 Aug 2012 20:32:53 GMT

When inserting a simple new document, at random times I get:

System.AggregateException: One or more errors occurred. ---> System.Exception: Page read error header invalid, number = 1
at RaptorDB.IndexFile`1.LoadPageFromPageNumber(Int32 number) in <path>RaptorDB\Indexes\IndexFile.cs:line 329
at RaptorDB.MGIndex`1.LoadPage(T key, PageInfo& pageinfo) in <path>RaptorDB\Indexes\MGIndex.cs:line 413
at RaptorDB.MGIndex`1.doEqualOp(RDBExpression exp, T key) in <path>RaptorDB\Indexes\MGIndex.cs:line 328
at RaptorDB.MGIndex`1.Query(RDBExpression exp, T from) in <path>RaptorDB\Indexes\MGIndex.cs:line 113
at RaptorDB.TypeIndexes`1.Query(RDBExpression ex, Object from) in <path>RaptorDB\Indexes\Indexes.cs:line 34
at RaptorDB.Views.ViewHandler.SaveAndIndex(Dictionary`2 rows) in <path>RaptorDB\Views\ViewHandler.cs:line 149
at RaptorDB.Views.ViewHandler.Insert[T](Guid guid, T doc) in <path>RaptorDB\Views\ViewHandler.cs:line 141
at RaptorDB.Views.ViewManager.<>c__DisplayClass2`1.<Insert>b__0() in <path>RaptorDB\Views\ViewManager.cs:line 126
at System.Threading.Tasks.Task.InnerInvoke()
at System.Threading.Tasks.Task.Execute()
--- End of inner exception stack trace ---
at System.Threading.Tasks.Task.WaitAll(Task[] tasks, Int32 millisecondsTimeout, CancellationToken cancellationToken)
at RaptorDB.Views.TaskQueue.Shutdown() in <path>RaptorDB\Views\TaskQueue.cs:line 64
at RaptorDB.Views.ViewManager.ShutDown() in <path>RaptorDB\Views\ViewManager.cs:line 216
at RaptorDB.RaptorDB.Shutdown() in <path>RaptorDB\RaptorDB.cs:line 294
at RaptorDbTest.Program.Main(String[] args) in <path>RaptorDbTest\RaptorDbTest\Program.cs:line 36
---> (Inner Exception #0) System.Exception: Page read error header invalid, number = 1
at RaptorDB.IndexFile`1.LoadPageFromPageNumber(Int32 number) in <path>RaptorDB\Indexes\IndexFile.cs:line 329
at RaptorDB.MGIndex`1.LoadPage(T key, PageInfo& pageinfo) in <path>RaptorDB\Indexes\MGIndex.cs:line 413
at RaptorDB.MGIndex`1.doEqualOp(RDBExpression exp, T key) in <path>RaptorDB\Indexes\MGIndex.cs:line 328
at RaptorDB.MGIndex`1.Query(RDBExpression exp, T from) in <path>RaptorDB\Indexes\MGIndex.cs:line 113
at RaptorDB.TypeIndexes`1.Query(RDBExpression ex, Object from) in <path>RaptorDB\Indexes\Indexes.cs:line 34
at RaptorDB.Views.ViewHandler.SaveAndIndex(Dictionary`2 rows) in <path>RaptorDB\Views\ViewHandler.cs:line 149
at RaptorDB.Views.ViewHandler.Insert[T](Guid guid, T doc) in <path>RaptorDB\Views\ViewHandler.cs:line 141
at RaptorDB.Views.ViewManager.<>c__DisplayClass2`1.<Insert>b__0() in <path>RaptorDB\Views\ViewManager.cs:line 126
at System.Threading.Tasks.Task.InnerInvoke()
at System.Threading.Tasks.Task.Execute()<---

It seems that it is a timing issue, as I cannot reproduce it in the debugger, and it usually only occurs once, then I have to delete all the database files and start over for it to be reproduced again. IndexFile.cs's line numbers might be off slightly, as I edited it to include debugging output: b[0] through b[3] appear to all be 0, and so they do not match the magic numbers of _BlockHeader (PAGE).

Commented Issue: Error when inserting [1]

08520302 — Thu, 09 Aug 2012 03:42:38 GMT

When I ran "datagridbinding" project and selected "Insert 100,000 Documents" more than 3 times, the error occurred as the image attached below. Please consider it.
Comments: I insert 100,000 records successfully (I think so because I saved all records without any exceptions thrown). When I start the raptor to query, the log file says Current Count = 100,000. But when I query like this: var q = rap.Query(typeof(MyView)); Then q.Count, q.TotalCount and q.Rows.Count are all equal 99,748 or something less than 100,000 Please help!

Commented Issue: Error when inserting [1]

08520302 — Thu, 09 Aug 2012 01:17:47 GMT

When I ran "datagridbinding" project and selected "Insert 100,000 Documents" more than 3 times, the error occurred as the image attached below. Please consider it.
Comments: Many thanks. I'm using a desktop pc (Intel Dual E2200, 2GB of Ram, using 32-bit system)

Commented Issue: Error when inserting [1]

MGholam — Wed, 08 Aug 2012 09:26:21 GMT

When I ran "datagridbinding" project and selected "Insert 100,000 Documents" more than 3 times, the error occurred as the image attached below. Please consider it.
Comments: If you are short on memory compile to 64 bit ( .net 32bit has a 2gb memory limit). I have fixed the bitmap save bug and optimized the bitmap index set method, so your issue *should* not occur again (you can set the save timer back to 60 sec). I will post the code soon.

Commented Issue: Error when inserting [1]

08520302 — Wed, 08 Aug 2012 08:20:11 GMT

When I ran "datagridbinding" project and selected "Insert 100,000 Documents" more than 3 times, the error occurred as the image attached below. Please consider it.
Comments: Thanks so much! It works when inserting 1,000,000 records at a time. But when I insert 100,000 records, then shutdown the raptor, and then open the raptor again to insert other 100,000 records, another issue occur. I have to do this way because I have some millions of records to save, and it's out of memory when I insert all of them at a time :( Here's the error: A Task's exception(s) were not observed either by Waiting on the Task or accessing its Exception property. As a result, the unobserved exception was rethrown by the finalizer thread. System.AggregateException: One or more errors occurred. ---> System.ArgumentException: An entry with the same key already exists. at System.ThrowHelper.ThrowArgumentException(ExceptionResource resource) at System.Collections.Generic.SortedList`2.Add(TKey key, TValue value) at RaptorDB.Common.SafeSortedList`2.Add(T key, V val) in D:\backup\raptordb-772a8c82751b\RaptorDB.Common\SafeDictionary.cs:line 99 at RaptorDB.MGIndex`1.SplitPage(Page`1 page) in D:\backup\raptordb-772a8c82751b\RaptorDB\Indexes\MGIndex.cs:line 391 at RaptorDB.MGIndex`1.Set(T key, Int32 val) in D:\backup\raptordb-772a8c82751b\RaptorDB\Indexes\MGIndex.cs:line 159 at RaptorDB.TypeIndexes`1.Set(Object key, Int32 recnum) in D:\backup\raptordb-772a8c82751b\RaptorDB\Indexes\Indexes.cs:line 23 at RaptorDB.Views.ViewHandler.IndexRow(Guid docid, Object[] row, Int32 rownum) in D:\backup\raptordb-772a8c82751b\RaptorDB\Views\ViewHandler.cs:line 550 at RaptorDB.Views.ViewHandler.InsertRowsWithIndexUpdate(Guid guid, List`1 rows) in D:\backup\raptordb-772a8c82751b\RaptorDB\Views\ViewHandler.cs:line 513 at RaptorDB.Views.ViewHandler.SaveAndIndex(Dictionary`2 rows) in D:\backup\raptordb-772a8c82751b\RaptorDB\Views\ViewHandler.cs:line 149 at RaptorDB.Views.ViewHandler.Insert[T](Guid guid, T doc) in D:\backup\raptordb-772a8c82751b\RaptorDB\Views\ViewHandler.cs:line 141 at RaptorDB.Views.ViewManager.<>c__DisplayClass2`1.<Insert>b__0() in D:\backup\raptordb-772a8c82751b\RaptorDB\Views\ViewManager.cs:line 126 at System.Threading.Tasks.Task.InnerInvoke() at System.Threading.Tasks.Task.Execute() --- End of inner exception stack trace --- at System.Threading.Tasks.Task.WaitAll(Task[] tasks, Int32 millisecondsTimeout, CancellationToken cancellationToken) at RaptorDB.Views.TaskQueue.Shutdown() in D:\backup\raptordb-772a8c82751b\RaptorDB\Views\TaskQueue.cs:line 64 at RaptorDB.Views.ViewManager.ShutDown() in D:\backup\raptordb-772a8c82751b\RaptorDB\Views\ViewManager.cs:line 216 at RaptorDB.RaptorDB.Shutdown() in D:\backup\raptordb-772a8c82751b\RaptorDB\RaptorDB.cs:line 294 at datagridbinding.Form1.insert() in D:\backup\raptordb-772a8c82751b\datagridbinding\Form1.cs:line 138 at datagridbinding.Form1.insert100000DocumentsToolStripMenuItem_Click(Object sender, EventArgs e) in D:\backup\raptordb-772a8c82751b\datagridbinding\Form1.cs:line 96 at System.Windows.Forms.ToolStripItem.RaiseEvent(Object key, EventArgs e) at System.Windows.Forms.ToolStripMenuItem.OnClick(EventArgs e) at System.Windows.Forms.ToolStripItem.HandleClick(EventArgs e) at System.Windows.Forms.ToolStripItem.HandleMouseUp(MouseEventArgs e) at System.Windows.Forms.ToolStripItem.FireEventInteractive(EventArgs e, ToolStripItemEventType met) at System.Windows.Forms.ToolStripItem.FireEvent(EventArgs e, ToolStripItemEventType met) at System.Windows.Forms.ToolStrip.OnMouseUp(MouseEventArgs mea) at System.Windows.Forms.Control.WmMouseUp(Message& m, MouseButtons button, Int32 clicks) at System.Windows.Forms.Control.WndProc(Message& m) at System.Windows.Forms.ScrollableControl.WndProc(Message& m) at System.Windows.Forms.ToolStrip.WndProc(Message& m) at System.Windows.Forms.MenuStrip.WndProc(Message& m) at System.Windows.Forms.Control.ControlNativeWindow.OnMessage(Message& m) at System.Windows.Forms.Control.ControlNativeWindow.WndProc(Message& m) at System.Windows.Forms.NativeWindow.Callback(IntPtr hWnd, Int32 msg, IntPtr wparam, IntPtr lparam) ---> (Inner Exception #0) System.ArgumentException: An entry with the same key already exists. at System.ThrowHelper.ThrowArgumentException(ExceptionResource resource) at System.Collections.Generic.SortedList`2.Add(TKey key, TValue value) at RaptorDB.Common.SafeSortedList`2.Add(T key, V val) in D:\backup\raptordb-772a8c82751b\RaptorDB.Common\SafeDictionary.cs:line 99 at RaptorDB.MGIndex`1.SplitPage(Page`1 page) in D:\backup\raptordb-772a8c82751b\RaptorDB\Indexes\MGIndex.cs:line 391 at RaptorDB.MGIndex`1.Set(T key, Int32 val) in D:\backup\raptordb-772a8c82751b\RaptorDB\Indexes\MGIndex.cs:line 159 at RaptorDB.TypeIndexes`1.Set(Object key, Int32 recnum) in D:\backup\raptordb-772a8c82751b\RaptorDB\Indexes\Indexes.cs:line 23 at RaptorDB.Views.ViewHandler.IndexRow(Guid docid, Object[] row, Int32 rownum) in D:\backup\raptordb-772a8c82751b\RaptorDB\Views\ViewHandler.cs:line 550 at RaptorDB.Views.ViewHandler.InsertRowsWithIndexUpdate(Guid guid, List`1 rows) in D:\backup\raptordb-772a8c82751b\RaptorDB\Views\ViewHandler.cs:line 513 at RaptorDB.Views.ViewHandler.SaveAndIndex(Dictionary`2 rows) in D:\backup\raptordb-772a8c82751b\RaptorDB\Views\ViewHandler.cs:line 149 at RaptorDB.Views.ViewHandler.Insert[T](Guid guid, T doc) in D:\backup\raptordb-772a8c82751b\RaptorDB\Views\ViewHandler.cs:line 141 at RaptorDB.Views.ViewManager.<>c__DisplayClass2`1.<Insert>b__0() in D:\backup\raptordb-772a8c82751b\RaptorDB\Views\ViewManager.cs:line 126 at System.Threading.Tasks.Task.InnerInvoke() at System.Threading.Tasks.Task.Execute()<---

Commented Issue: Error when inserting [1]

MGholam — Tue, 07 Aug 2012 05:15:45 GMT

When I ran "datagridbinding" project and selected "Insert 100,000 Documents" more than 3 times, the error occurred as the image attached below. Please consider it.
Comments: Increase Globals.SaveIndexToDiskTimerSeconds to say 500 and let me know.

Commented Issue: Error when inserting [1]

08520302 — Tue, 07 Aug 2012 02:58:20 GMT

When I ran "datagridbinding" project and selected "Insert 100,000 Documents" more than 3 times, the error occurred as the image attached below. Please consider it.
Comments: when I tried to insert 1000000 instead of 100000 records, this error also occurred.

Commented Issue: Error when inserting [1]

08520302 — Tue, 07 Aug 2012 02:36:20 GMT

When I ran "datagridbinding" project and selected "Insert 100,000 Documents" more than 3 times, the error occurred as the image attached below. Please consider it.
Comments: Here's the stack trace: at System.ThrowHelper.ThrowInvalidOperationException (ExceptionResource resource) at System.Collections.Generic.Dictionary`2.Enumerator.MoveNext() at RaptorDB.BitmapIndex.Commit(Boolean freeMemory) in D:\raptordb-772a8c82751b\RaptorDB\Indexes\BitmapIndex.cs:line 92 p/s: In my case, line 92 at BitmapIndex.cs is "foreach (KeyValuePair<int, WAHBitArray> kv in _cache)"

Commented Issue: Error when inserting [1]

MGholam — Mon, 06 Aug 2012 09:54:10 GMT

When I ran "datagridbinding" project and selected "Insert 100,000 Documents" more than 3 times, the error occurred as the image attached below. Please consider it.
Comments: Please send the stack trace.