Failed to pass the test from pyes

classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Failed to pass the test from pyes

Kerui Min
Hi all,

I have some problem to start working on the elasticsearch. I
downloaded the latest version from the website, and download pyes 0.16
as the connector. Everything looks fine, but somehow it failed to pass
the test pyes/tests/indexing.py. Here is the output from indexing.py:

.............F.
======================================================================
FAIL: testMLT (__main__.IndexingTestCase)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "indexing.py", line 141, in testMLT
    self.assertResultContains(result, {u'_shards': {u'successful': 5,
 0, u'total': 5}})
  File "C:\Python27\lib\site-packages\pyes-0.16.0-py2.7.egg\pyes\tests
py", line 24, in assertResultContains
    self.assertEquals(value, result[key])
AssertionError: {u'successful': 5, u'failed': 0, u'total': 5} != {u'su
 1, u'failed': 0, u'total': 1}
- {u'failed': 0, u'successful': 5, u'total': 5}
?                               ^            ^

+ {u'failed': 0, u'successful': 1, u'total': 1}
?                               ^            ^


----------------------------------------------------------------------
Ran 15 tests in 9.806s

FAILED (failures=1)

On the other hand, here is the error message raised by the
elasticsearch server:

[2011-12-26 15:03:51,756][DEBUG][action.admin.indices.refresh]
[Aardwolf] [anoth
er-index][3], node[72m8MJXiRy-oyetVL2Iz_w], [P], s[INITIALIZING]:
Failed to exec
ute
[org.elasticsearch.action.admin.indices.refresh.RefreshRequest@1c38ba8f]
org.elasticsearch.index.IndexShardMissingException: [another-index][3]
missing
        at
org.elasticsearch.index.service.InternalIndexService.shardSafe(Intern
alIndexService.java:177)
        at
org.elasticsearch.action.admin.indices.refresh.TransportRefreshAction
.shardOperation(TransportRefreshAction.java:128)
        at
org.elasticsearch.action.admin.indices.refresh.TransportRefreshAction
.shardOperation(TransportRefreshAction.java:53)
        at
org.elasticsearch.action.support.broadcast.TransportBroadcastOperatio
nAction
$AsyncBroadcastAction.performOperation(TransportBroadcastOperationAction.
java:232)
        at
org.elasticsearch.action.support.broadcast.TransportBroadcastOperatio
nAction
$AsyncBroadcastAction.performOperation(TransportBroadcastOperationAction.
java:210)
        at
org.elasticsearch.action.support.broadcast.TransportBroadcastOperatio
nAction$AsyncBroadcastAction
$1.run(TransportBroadcastOperationAction.java:186)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.
java:1110)
        at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor
.java:603)
        at java.lang.Thread.run(Thread.java:722)
[2011-12-26 15:03:51,787][DEBUG][action.admin.indices.refresh]
[Aardwolf] [anoth
er-index][4], node[72m8MJXiRy-oyetVL2Iz_w], [P], s[INITIALIZING]:
Failed to exec
ute
[org.elasticsearch.action.admin.indices.refresh.RefreshRequest@1c38ba8f]
org.elasticsearch.index.IndexShardMissingException: [another-index][4]
missing
        at
org.elasticsearch.index.service.InternalIndexService.shardSafe(Intern
alIndexService.java:177)
        at
org.elasticsearch.action.admin.indices.refresh.TransportRefreshAction
.shardOperation(TransportRefreshAction.java:128)
        at
org.elasticsearch.action.admin.indices.refresh.TransportRefreshAction
.shardOperation(TransportRefreshAction.java:53)
        at
org.elasticsearch.action.support.broadcast.TransportBroadcastOperatio
nAction
$AsyncBroadcastAction.performOperation(TransportBroadcastOperationAction.
java:232)
        at
org.elasticsearch.action.support.broadcast.TransportBroadcastOperatio
nAction
$AsyncBroadcastAction.performOperation(TransportBroadcastOperationAction.
java:210)
        at
org.elasticsearch.action.support.broadcast.TransportBroadcastOperatio
nAction$AsyncBroadcastAction
$1.run(TransportBroadcastOperationAction.java:186)
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.
java:1110)
        at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor
.java:603)
        at java.lang.Thread.run(Thread.java:722)

I'm wondering if there is anything wrong with my configuration?

My OS: Windows 7 with jdk1.7.0_01.
Thank you!


Kerui Min
Reply | Threaded
Open this post in threaded view
|

Re: Failed to pass the test from pyes

kimchy
Administrator
Thats a failure that should be ignored in elasticsearch (as it might happen as part of refresh), you can ignore it. I pushed a fix to ignore it in master.

On Mon, Dec 26, 2011 at 9:08 AM, Kerui Min <[hidden email]> wrote:
Hi all,

I have some problem to start working on the elasticsearch. I
downloaded the latest version from the website, and download pyes 0.16
as the connector. Everything looks fine, but somehow it failed to pass
the test pyes/tests/indexing.py. Here is the output from indexing.py:

.............F.
======================================================================
FAIL: testMLT (__main__.IndexingTestCase)
----------------------------------------------------------------------
Traceback (most recent call last):
 File "indexing.py", line 141, in testMLT
   self.assertResultContains(result, {u'_shards': {u'successful': 5,
 0, u'total': 5}})
 File "C:\Python27\lib\site-packages\pyes-0.16.0-py2.7.egg\pyes\tests
py", line 24, in assertResultContains
   self.assertEquals(value, result[key])
AssertionError: {u'successful': 5, u'failed': 0, u'total': 5} != {u'su
 1, u'failed': 0, u'total': 1}
- {u'failed': 0, u'successful': 5, u'total': 5}
?                               ^            ^

+ {u'failed': 0, u'successful': 1, u'total': 1}
?                               ^            ^


----------------------------------------------------------------------
Ran 15 tests in 9.806s

FAILED (failures=1)

On the other hand, here is the error message raised by the
elasticsearch server:

[2011-12-26 15:03:51,756][DEBUG][action.admin.indices.refresh]
[Aardwolf] [anoth
er-index][3], node[72m8MJXiRy-oyetVL2Iz_w], [P], s[INITIALIZING]:
Failed to exec
ute
[org.elasticsearch.action.admin.indices.refresh.RefreshRequest@1c38ba8f]
org.elasticsearch.index.IndexShardMissingException: [another-index][3]
missing
       at
org.elasticsearch.index.service.InternalIndexService.shardSafe(Intern
alIndexService.java:177)
       at
org.elasticsearch.action.admin.indices.refresh.TransportRefreshAction
.shardOperation(TransportRefreshAction.java:128)
       at
org.elasticsearch.action.admin.indices.refresh.TransportRefreshAction
.shardOperation(TransportRefreshAction.java:53)
       at
org.elasticsearch.action.support.broadcast.TransportBroadcastOperatio
nAction
$AsyncBroadcastAction.performOperation(TransportBroadcastOperationAction.
java:232)
       at
org.elasticsearch.action.support.broadcast.TransportBroadcastOperatio
nAction
$AsyncBroadcastAction.performOperation(TransportBroadcastOperationAction.
java:210)
       at
org.elasticsearch.action.support.broadcast.TransportBroadcastOperatio
nAction$AsyncBroadcastAction
$1.run(TransportBroadcastOperationAction.java:186)
       at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.
java:1110)
       at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor
.java:603)
       at java.lang.Thread.run(Thread.java:722)
[2011-12-26 15:03:51,787][DEBUG][action.admin.indices.refresh]
[Aardwolf] [anoth
er-index][4], node[72m8MJXiRy-oyetVL2Iz_w], [P], s[INITIALIZING]:
Failed to exec
ute
[org.elasticsearch.action.admin.indices.refresh.RefreshRequest@1c38ba8f]
org.elasticsearch.index.IndexShardMissingException: [another-index][4]
missing
       at
org.elasticsearch.index.service.InternalIndexService.shardSafe(Intern
alIndexService.java:177)
       at
org.elasticsearch.action.admin.indices.refresh.TransportRefreshAction
.shardOperation(TransportRefreshAction.java:128)
       at
org.elasticsearch.action.admin.indices.refresh.TransportRefreshAction
.shardOperation(TransportRefreshAction.java:53)
       at
org.elasticsearch.action.support.broadcast.TransportBroadcastOperatio
nAction
$AsyncBroadcastAction.performOperation(TransportBroadcastOperationAction.
java:232)
       at
org.elasticsearch.action.support.broadcast.TransportBroadcastOperatio
nAction
$AsyncBroadcastAction.performOperation(TransportBroadcastOperationAction.
java:210)
       at
org.elasticsearch.action.support.broadcast.TransportBroadcastOperatio
nAction$AsyncBroadcastAction
$1.run(TransportBroadcastOperationAction.java:186)
       at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.
java:1110)
       at java.util.concurrent.ThreadPoolExecutor
$Worker.run(ThreadPoolExecutor
.java:603)
       at java.lang.Thread.run(Thread.java:722)

I'm wondering if there is anything wrong with my configuration?

My OS: Windows 7 with jdk1.7.0_01.
Thank you!


Kerui Min

Reply | Threaded
Open this post in threaded view
|

Re: Failed to pass the test from pyes

Kerui Min
Thank you for the reply. I guess some of the testing failures are due
to the fact that pyes is slightly out of date.


Kerui Min

On Dec 26, 10:33 pm, Shay Banon <[hidden email]> wrote:

> Thats a failure that should be ignored in elasticsearch (as it might happen
> as part of refresh), you can ignore it. I pushed a fix to ignore it in
> master.
>
>
>
>
>
>
>
> On Mon, Dec 26, 2011 at 9:08 AM, Kerui Min <[hidden email]> wrote:
> > Hi all,
>
> > I have some problem to start working on the elasticsearch. I
> > downloaded the latest version from the website, and download pyes 0.16
> > as the connector. Everything looks fine, but somehow it failed to pass
> > the test pyes/tests/indexing.py. Here is the output from indexing.py:
>
> > .............F.
> > ======================================================================
> > FAIL: testMLT (__main__.IndexingTestCase)
> > ----------------------------------------------------------------------
> > Traceback (most recent call last):
> >  File "indexing.py", line 141, in testMLT
> >    self.assertResultContains(result, {u'_shards': {u'successful': 5,
> >  0, u'total': 5}})
> >  File "C:\Python27\lib\site-packages\pyes-0.16.0-py2.7.egg\pyes\tests
> > py", line 24, in assertResultContains
> >    self.assertEquals(value, result[key])
> > AssertionError: {u'successful': 5, u'failed': 0, u'total': 5} != {u'su
> >  1, u'failed': 0, u'total': 1}
> > - {u'failed': 0, u'successful': 5, u'total': 5}
> > ?                               ^            ^
>
> > + {u'failed': 0, u'successful': 1, u'total': 1}
> > ?                               ^            ^
>
> > ----------------------------------------------------------------------
> > Ran 15 tests in 9.806s
>
> > FAILED (failures=1)
>
> > On the other hand, here is the error message raised by the
> > elasticsearch server:
>
> > [2011-12-26 15:03:51,756][DEBUG][action.admin.indices.refresh]
> > [Aardwolf] [anoth
> > er-index][3], node[72m8MJXiRy-oyetVL2Iz_w], [P], s[INITIALIZING]:
> > Failed to exec
> > ute
> > [org.elasticsearch.action.admin.indices.refresh.RefreshRequest@1c38ba8f]
> > org.elasticsearch.index.IndexShardMissingException: [another-index][3]
> > missing
> >        at
> > org.elasticsearch.index.service.InternalIndexService.shardSafe(Intern
> > alIndexService.java:177)
> >        at
> > org.elasticsearch.action.admin.indices.refresh.TransportRefreshAction
> > .shardOperation(TransportRefreshAction.java:128)
> >        at
> > org.elasticsearch.action.admin.indices.refresh.TransportRefreshAction
> > .shardOperation(TransportRefreshAction.java:53)
> >        at
> > org.elasticsearch.action.support.broadcast.TransportBroadcastOperatio
> > nAction
> > $AsyncBroadcastAction.performOperation(TransportBroadcastOperationAction.
> > java:232)
> >        at
> > org.elasticsearch.action.support.broadcast.TransportBroadcastOperatio
> > nAction
> > $AsyncBroadcastAction.performOperation(TransportBroadcastOperationAction.
> > java:210)
> >        at
> > org.elasticsearch.action.support.broadcast.TransportBroadcastOperatio
> > nAction$AsyncBroadcastAction
> > $1.run(TransportBroadcastOperationAction.java:186)
> >        at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.
> > java:1110)
> >        at java.util.concurrent.ThreadPoolExecutor
> > $Worker.run(ThreadPoolExecutor
> > .java:603)
> >        at java.lang.Thread.run(Thread.java:722)
> > [2011-12-26 15:03:51,787][DEBUG][action.admin.indices.refresh]
> > [Aardwolf] [anoth
> > er-index][4], node[72m8MJXiRy-oyetVL2Iz_w], [P], s[INITIALIZING]:
> > Failed to exec
> > ute
> > [org.elasticsearch.action.admin.indices.refresh.RefreshRequest@1c38ba8f]
> > org.elasticsearch.index.IndexShardMissingException: [another-index][4]
> > missing
> >        at
> > org.elasticsearch.index.service.InternalIndexService.shardSafe(Intern
> > alIndexService.java:177)
> >        at
> > org.elasticsearch.action.admin.indices.refresh.TransportRefreshAction
> > .shardOperation(TransportRefreshAction.java:128)
> >        at
> > org.elasticsearch.action.admin.indices.refresh.TransportRefreshAction
> > .shardOperation(TransportRefreshAction.java:53)
> >        at
> > org.elasticsearch.action.support.broadcast.TransportBroadcastOperatio
> > nAction
> > $AsyncBroadcastAction.performOperation(TransportBroadcastOperationAction.
> > java:232)
> >        at
> > org.elasticsearch.action.support.broadcast.TransportBroadcastOperatio
> > nAction
> > $AsyncBroadcastAction.performOperation(TransportBroadcastOperationAction.
> > java:210)
> >        at
> > org.elasticsearch.action.support.broadcast.TransportBroadcastOperatio
> > nAction$AsyncBroadcastAction
> > $1.run(TransportBroadcastOperationAction.java:186)
> >        at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.
> > java:1110)
> >        at java.util.concurrent.ThreadPoolExecutor
> > $Worker.run(ThreadPoolExecutor
> > .java:603)
> >        at java.lang.Thread.run(Thread.java:722)
>
> > I'm wondering if there is anything wrong with my configuration?
>
> > My OS: Windows 7 with jdk1.7.0_01.
> > Thank you!
>
> > Kerui Min
Reply | Threaded
Open this post in threaded view
|

Re: Failed to pass the test from pyes

Alberto Paro-2
the test failure is due to the default es configuration is a 5 shards index. in your setup, you are using an 1 shard index.

The main development of pyes is on github. The pypi version is outdated.

hi,
Alberto

Inviato da iPhone

Il giorno 27/dic/2011, alle ore 00:19, Kerui Min <[hidden email]> ha scritto:

> Thank you for the reply. I guess some of the testing failures are due
> to the fact that pyes is slightly out of date.
>
>
> Kerui Min
>
> On Dec 26, 10:33 pm, Shay Banon <[hidden email]> wrote:
>> Thats a failure that should be ignored in elasticsearch (as it might happen
>> as part of refresh), you can ignore it. I pushed a fix to ignore it in
>> master.
>>
>>
>>
>>
>>
>>
>>
>> On Mon, Dec 26, 2011 at 9:08 AM, Kerui Min <[hidden email]> wrote:
>>> Hi all,
>>
>>> I have some problem to start working on the elasticsearch. I
>>> downloaded the latest version from the website, and download pyes 0.16
>>> as the connector. Everything looks fine, but somehow it failed to pass
>>> the test pyes/tests/indexing.py. Here is the output from indexing.py:
>>
>>> .............F.
>>> ======================================================================
>>> FAIL: testMLT (__main__.IndexingTestCase)
>>> ----------------------------------------------------------------------
>>> Traceback (most recent call last):
>>>  File "indexing.py", line 141, in testMLT
>>>    self.assertResultContains(result, {u'_shards': {u'successful': 5,
>>>  0, u'total': 5}})
>>>  File "C:\Python27\lib\site-packages\pyes-0.16.0-py2.7.egg\pyes\tests
>>> py", line 24, in assertResultContains
>>>    self.assertEquals(value, result[key])
>>> AssertionError: {u'successful': 5, u'failed': 0, u'total': 5} != {u'su
>>>  1, u'failed': 0, u'total': 1}
>>> - {u'failed': 0, u'successful': 5, u'total': 5}
>>> ?                               ^            ^
>>
>>> + {u'failed': 0, u'successful': 1, u'total': 1}
>>> ?                               ^            ^
>>
>>> ----------------------------------------------------------------------
>>> Ran 15 tests in 9.806s
>>
>>> FAILED (failures=1)
>>
>>> On the other hand, here is the error message raised by the
>>> elasticsearch server:
>>
>>> [2011-12-26 15:03:51,756][DEBUG][action.admin.indices.refresh]
>>> [Aardwolf] [anoth
>>> er-index][3], node[72m8MJXiRy-oyetVL2Iz_w], [P], s[INITIALIZING]:
>>> Failed to exec
>>> ute
>>> [org.elasticsearch.action.admin.indices.refresh.RefreshRequest@1c38ba8f]
>>> org.elasticsearch.index.IndexShardMissingException: [another-index][3]
>>> missing
>>>        at
>>> org.elasticsearch.index.service.InternalIndexService.shardSafe(Intern
>>> alIndexService.java:177)
>>>        at
>>> org.elasticsearch.action.admin.indices.refresh.TransportRefreshAction
>>> .shardOperation(TransportRefreshAction.java:128)
>>>        at
>>> org.elasticsearch.action.admin.indices.refresh.TransportRefreshAction
>>> .shardOperation(TransportRefreshAction.java:53)
>>>        at
>>> org.elasticsearch.action.support.broadcast.TransportBroadcastOperatio
>>> nAction
>>> $AsyncBroadcastAction.performOperation(TransportBroadcastOperationAction.
>>> java:232)
>>>        at
>>> org.elasticsearch.action.support.broadcast.TransportBroadcastOperatio
>>> nAction
>>> $AsyncBroadcastAction.performOperation(TransportBroadcastOperationAction.
>>> java:210)
>>>        at
>>> org.elasticsearch.action.support.broadcast.TransportBroadcastOperatio
>>> nAction$AsyncBroadcastAction
>>> $1.run(TransportBroadcastOperationAction.java:186)
>>>        at
>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.
>>> java:1110)
>>>        at java.util.concurrent.ThreadPoolExecutor
>>> $Worker.run(ThreadPoolExecutor
>>> .java:603)
>>>        at java.lang.Thread.run(Thread.java:722)
>>> [2011-12-26 15:03:51,787][DEBUG][action.admin.indices.refresh]
>>> [Aardwolf] [anoth
>>> er-index][4], node[72m8MJXiRy-oyetVL2Iz_w], [P], s[INITIALIZING]:
>>> Failed to exec
>>> ute
>>> [org.elasticsearch.action.admin.indices.refresh.RefreshRequest@1c38ba8f]
>>> org.elasticsearch.index.IndexShardMissingException: [another-index][4]
>>> missing
>>>        at
>>> org.elasticsearch.index.service.InternalIndexService.shardSafe(Intern
>>> alIndexService.java:177)
>>>        at
>>> org.elasticsearch.action.admin.indices.refresh.TransportRefreshAction
>>> .shardOperation(TransportRefreshAction.java:128)
>>>        at
>>> org.elasticsearch.action.admin.indices.refresh.TransportRefreshAction
>>> .shardOperation(TransportRefreshAction.java:53)
>>>        at
>>> org.elasticsearch.action.support.broadcast.TransportBroadcastOperatio
>>> nAction
>>> $AsyncBroadcastAction.performOperation(TransportBroadcastOperationAction.
>>> java:232)
>>>        at
>>> org.elasticsearch.action.support.broadcast.TransportBroadcastOperatio
>>> nAction
>>> $AsyncBroadcastAction.performOperation(TransportBroadcastOperationAction.
>>> java:210)
>>>        at
>>> org.elasticsearch.action.support.broadcast.TransportBroadcastOperatio
>>> nAction$AsyncBroadcastAction
>>> $1.run(TransportBroadcastOperationAction.java:186)
>>>        at
>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.
>>> java:1110)
>>>        at java.util.concurrent.ThreadPoolExecutor
>>> $Worker.run(ThreadPoolExecutor
>>> .java:603)
>>>        at java.lang.Thread.run(Thread.java:722)
>>
>>> I'm wondering if there is anything wrong with my configuration?
>>
>>> My OS: Windows 7 with jdk1.7.0_01.
>>> Thank you!
>>
>>> Kerui Min