[prev in list] [next in list] [prev in thread] [next in thread] 

List:       cassandra-user
Subject:    Cassandra 3.11.1 java.lang.UnsatisfiedLinkError Exception when using Leveled Compaction
From:       Bruce Tietjen <bruce.tietjen () imatsolutions ! com>
Date:       2017-10-27 22:05:02
Message-ID: CAOVrvuZKN+FZrecAMYxWibMA=izo3D3xw5e=RoNozWeZzrvE5A () mail ! gmail ! com
[Download RAW message or body]

We are using 3.11.1 (which we recently upgraded from 3.11.0) and just
started experimenting with LeveledCompactionStrategy. After loading data
for 24 hours, we started getting the following error:

ERROR [CompactionExecutor:628] 2017-10-27 11:58:21,748
CassandraDaemon.java:228 - Exception in thread
Thread[CompactionExecutor:628,1,main] java.lang.UnsatisfiedLinkError: no
nio in java.library.path

This seems strange that we would encounter this kind error and are
wondering if we might be missing some Java classes not included in the
install or what else we might have done wrong.

It looks like writes to the cluster may have slowed to about 1/4 what it
had been doing sometime around the time when we started seeing this error.


We would be grateful for any pointers as to what to look at.

-- Thanks --

PS Following is more detail that might be helpful

We are running OpenJDK 8 on CentOS 7.

Following is the full traceback:
ERROR [CompactionExecutor:628] 2017-10-27 11:58:21,748
CassandraDaemon.java:228 - Exception in thread
Thread[CompactionExecutor:628,1,main]
java.lang.UnsatisfiedLinkError: no nio in java.library.path
        at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867)
~[na:1.8.0_144]
        at java.lang.Runtime.loadLibrary0(Runtime.java:870) ~[na:1.8.0_144]
        at java.lang.System.loadLibrary(System.java:1122) ~[na:1.8.0_144]
        at sun.nio.fs.UnixCopyFile$2.run(UnixCopyFile.java:612)
~[na:1.8.0_144]
        at sun.nio.fs.UnixCopyFile$2.run(UnixCopyFile.java:609)
~[na:1.8.0_144]
        at java.security.AccessController.doPrivileged(Native Method)
~[na:1.8.0_144]
        at sun.nio.fs.UnixCopyFile.<clinit>(UnixCopyFile.java:609)
~[na:1.8.0_144]
        at
sun.nio.fs.UnixFileSystemProvider.move(UnixFileSystemProvider.java:262)
~[na:1.8.0_144]
        at java.nio.file.Files.move(Files.java:1395) ~[na:1.8.0_144]
        at
org.apache.cassandra.io.util.FileUtils.atomicMoveWithFallback(FileUtils.java:207)
~[apache-cassandra-3.11.1.jar:3.11.1]
        at
org.apache.cassandra.io.util.FileUtils.renameWithConfirm(FileUtils.java:189)
~[apache-cassandra-3.11.1.jar:3.11.1]
        at
org.apache.cassandra.io.util.FileUtils.renameWithConfirm(FileUtils.java:177)
~[apache-cassandra-3.11.1.jar:3.11.1]
        at
org.apache.cassandra.io.sstable.metadata.MetadataSerializer.rewriteSSTableMetadata(MetadataSerializer.java:160)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at
org.apache.cassandra.io.sstable.metadata.MetadataSerializer.mutateLevel(MetadataSerializer.java:136)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at
org.apache.cassandra.db.compaction.LeveledManifest.add(LeveledManifest.java:165)
~[apache-cassandra-3.11.1.jar:3.11.1]
        at
org.apache.cassandra.db.compaction.LeveledManifest.replace(LeveledManifest.java:201)
~[apache-cassandra-3.11.1.jar:3.11.1]
        at
org.apache.cassandra.db.compaction.LeveledCompactionStrategy.replaceSSTables(LeveledCompactionStrategy.java:327)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at
org.apache.cassandra.db.compaction.CompactionStrategyManager.handleListChangedNotification(CompactionStrategyManager.java:494)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at
org.apache.cassandra.db.compaction.CompactionStrategyManager.handleNotification(CompactionStrategyManager.java:555)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at
org.apache.cassandra.db.lifecycle.Tracker.notifySSTablesChanged(Tracker.java:410)
~[apache-cassandra-3.11.1.jar:3.11.1]
        at
org.apache.cassandra.db.lifecycle.LifecycleTransaction.doCommit(LifecycleTransaction.java:227)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at
org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.commit(Transactional.java:116)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at
org.apache.cassandra.io.sstable.SSTableRewriter.doCommit(SSTableRewriter.java:206)
~[apache-cassandra-3.11.1.jar:3.11.1]
        at
org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.commit(Transactional.java:116)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at
org.apache.cassandra.db.compaction.writers.CompactionAwareWriter.doCommit(CompactionAwareWriter.java:105)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at
org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.commit(Transactional.java:116)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at
org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.commit(Transactional.java:200)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at
org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.finish(Transactional.java:185)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at
org.apache.cassandra.db.compaction.writers.CompactionAwareWriter.finish(CompactionAwareWriter.java:121)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at
org.apache.cassandra.db.compaction.CompactionTask.runMayThrow(CompactionTask.java:220)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at
org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28)
~[apache-cassandra-3.11.1.jar:3.11.1]
        at
org.apache.cassandra.db.compaction.CompactionTask.executeInternal(CompactionTask.java:85)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at
org.apache.cassandra.db.compaction.AbstractCompactionTask.execute(AbstractCompactionTask.java:61)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at
org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionCandidate.run(CompactionManager.java:268)
 ~[apache-cassandra-3.11.1.jar:3.11.1]
        at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
~[na:1.8.0_144]
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
~[na:1.8.0_144]
        at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
~[na:1.8.0_144]
        at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[na:1.8.0_144]
        at
org.apache.cassandra.concurrent.NamedThreadFactory.lambda$threadLocalDeallocator$0(NamedThreadFactory.java:81)
 [apache-cassandra-3.11.1.jar:3.11.1]
        at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_144]


[Attachment #3 (text/html)]

<div dir="ltr"><div>We are using 3.11.1 (which we recently upgraded from 3.11.0) and \
just started experimenting with LeveledCompactionStrategy. After loading data for 24 \
hours, we started getting the following error:</div><div><br></div><div><div>ERROR \
[CompactionExecutor:628] 2017-10-27 11:58:21,748 CassandraDaemon.java:228 - Exception \
in thread Thread[CompactionExecutor:628,1,main] java.lang.UnsatisfiedLinkError: no \
nio in java.library.path</div></div><div><br></div><div><div>This seems strange that \
we would encounter this kind error and are wondering if we might be missing some Java \
classes not included in the install or what else we might have done \
wrong.</div></div><div><br></div><div>It looks like writes to the cluster may have \
slowed to about 1/4 what it had been doing sometime around the time when we started \
seeing this error.</div><div><br></div><div><br></div><div>We would be grateful for \
any pointers as to what to look at.</div><div><br></div><div>-- Thanks \
--</div><div><br></div><div>PS Following is more detail that might be \
helpful</div><div><br></div><div>We are running OpenJDK 8 on CentOS \
7.</div><div><br></div><div>Following is the full traceback:</div><div>ERROR \
[CompactionExecutor:628] 2017-10-27 11:58:21,748 CassandraDaemon.java:228 - Exception \
in thread Thread[CompactionExecutor:628,1,main]<br></div><div><div>java.lang.UnsatisfiedLinkError: \
no nio in java.library.path</div><div>            at \
java.lang.ClassLoader.loadLibrary(ClassLoader.java:1867) ~[na:1.8.0_144]</div><div>   \
at java.lang.Runtime.loadLibrary0(Runtime.java:870) ~[na:1.8.0_144]</div><div>        \
at java.lang.System.loadLibrary(System.java:1122) ~[na:1.8.0_144]</div><div>          \
at sun.nio.fs.UnixCopyFile$2.run(UnixCopyFile.java:612) ~[na:1.8.0_144]</div><div>    \
at sun.nio.fs.UnixCopyFile$2.run(UnixCopyFile.java:609) ~[na:1.8.0_144]</div><div>    \
at java.security.AccessController.doPrivileged(Native Method) \
~[na:1.8.0_144]</div><div>            at \
sun.nio.fs.UnixCopyFile.&lt;clinit&gt;(UnixCopyFile.java:609) \
~[na:1.8.0_144]</div><div>            at \
sun.nio.fs.UnixFileSystemProvider.move(UnixFileSystemProvider.java:262) \
~[na:1.8.0_144]</div><div>            at java.nio.file.Files.move(Files.java:1395) \
~[na:1.8.0_144]</div><div>            at \
org.apache.cassandra.io.util.FileUtils.atomicMoveWithFallback(FileUtils.java:207) \
~[apache-cassandra-3.11.1.jar:3.11.1]</div><div>            at \
org.apache.cassandra.io.util.FileUtils.renameWithConfirm(FileUtils.java:189) \
~[apache-cassandra-3.11.1.jar:3.11.1]</div><div>            at \
org.apache.cassandra.io.util.FileUtils.renameWithConfirm(FileUtils.java:177) \
~[apache-cassandra-3.11.1.jar:3.11.1]</div><div>            at \
org.apache.cassandra.io.sstable.metadata.MetadataSerializer.rewriteSSTableMetadata(MetadataSerializer.java:160) \
~[apache-cassandra-3.11.1.jar:3.11.1]</div><div>            at \
org.apache.cassandra.io.sstable.metadata.MetadataSerializer.mutateLevel(MetadataSerializer.java:136) \
~[apache-cassandra-3.11.1.jar:3.11.1]</div><div>            at \
org.apache.cassandra.db.compaction.LeveledManifest.add(LeveledManifest.java:165) \
~[apache-cassandra-3.11.1.jar:3.11.1]</div><div>            at \
org.apache.cassandra.db.compaction.LeveledManifest.replace(LeveledManifest.java:201) \
~[apache-cassandra-3.11.1.jar:3.11.1]</div><div>            at \
org.apache.cassandra.db.compaction.LeveledCompactionStrategy.replaceSSTables(LeveledCompactionStrategy.java:327) \
~[apache-cassandra-3.11.1.jar:3.11.1]</div><div>            at \
org.apache.cassandra.db.compaction.CompactionStrategyManager.handleListChangedNotification(CompactionStrategyManager.java:494) \
~[apache-cassandra-3.11.1.jar:3.11.1]</div><div>            at \
org.apache.cassandra.db.compaction.CompactionStrategyManager.handleNotification(CompactionStrategyManager.java:555) \
~[apache-cassandra-3.11.1.jar:3.11.1]</div><div>            at \
org.apache.cassandra.db.lifecycle.Tracker.notifySSTablesChanged(Tracker.java:410) \
~[apache-cassandra-3.11.1.jar:3.11.1]</div><div>            at \
org.apache.cassandra.db.lifecycle.LifecycleTransaction.doCommit(LifecycleTransaction.java:227) \
~[apache-cassandra-3.11.1.jar:3.11.1]</div><div>            at \
org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.commit(Transactional.java:116) \
~[apache-cassandra-3.11.1.jar:3.11.1]</div><div>            at \
org.apache.cassandra.io.sstable.SSTableRewriter.doCommit(SSTableRewriter.java:206) \
~[apache-cassandra-3.11.1.jar:3.11.1]</div><div>            at \
org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.commit(Transactional.java:116) \
~[apache-cassandra-3.11.1.jar:3.11.1]</div><div>            at \
org.apache.cassandra.db.compaction.writers.CompactionAwareWriter.doCommit(CompactionAwareWriter.java:105) \
~[apache-cassandra-3.11.1.jar:3.11.1]</div><div>            at \
org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.commit(Transactional.java:116) \
~[apache-cassandra-3.11.1.jar:3.11.1]</div><div>            at \
org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.commit(Transactional.java:200) \
~[apache-cassandra-3.11.1.jar:3.11.1]</div><div>            at \
org.apache.cassandra.utils.concurrent.Transactional$AbstractTransactional.finish(Transactional.java:185) \
~[apache-cassandra-3.11.1.jar:3.11.1]</div><div>            at \
org.apache.cassandra.db.compaction.writers.CompactionAwareWriter.finish(CompactionAwareWriter.java:121) \
~[apache-cassandra-3.11.1.jar:3.11.1]</div><div>            at \
org.apache.cassandra.db.compaction.CompactionTask.runMayThrow(CompactionTask.java:220) \
~[apache-cassandra-3.11.1.jar:3.11.1]</div><div>            at \
org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) \
~[apache-cassandra-3.11.1.jar:3.11.1]</div><div>            at \
org.apache.cassandra.db.compaction.CompactionTask.executeInternal(CompactionTask.java:85) \
~[apache-cassandra-3.11.1.jar:3.11.1]</div><div>            at \
org.apache.cassandra.db.compaction.AbstractCompactionTask.execute(AbstractCompactionTask.java:61) \
~[apache-cassandra-3.11.1.jar:3.11.1]</div><div>            at \
org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionCandidate.run(CompactionManager.java:268) \
~[apache-cassandra-3.11.1.jar:3.11.1]</div><div>            at \
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) \
~[na:1.8.0_144]</div><div>            at \
java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_144]</div><div>   \
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) \
~[na:1.8.0_144]</div><div>            at \
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) \
[na:1.8.0_144]</div><div>            at \
org.apache.cassandra.concurrent.NamedThreadFactory.lambda$threadLocalDeallocator$0(NamedThreadFactory.java:81) \
[apache-cassandra-3.11.1.jar:3.11.1]</div><div>            at \
java.lang.Thread.run(Thread.java:748) \
~[na:1.8.0_144]</div></div><div><br></div><div><br></div></div>



[prev in list] [next in list] [prev in thread] [next in thread] 

Configure | About | News | Add a list | Sponsored by KoreLogic