Go-ethereum: Geth 1.4.13- mining - fatal error: unexpected signal during runtime execution

[niladribhandari]

System information

Geth
Version: 1.4.13-stable-8f0db697
Protocol Versions: [63 62]
Network Id: 1
Go Version: go1.6
OS: linux (Ubuntu 14.04.5 LTS)
GOPATH=/home/ubuntu/go
GOROOT=/usr/local/go

Expected behaviour

Setting up private net to handle requests from JSON RPC as well as Web3

Actual behaviour

Geth is crashing after mining few hours

Steps to reproduce the behaviour

1. Downloaded source (git clone https://github.com/ethereum/go-ethereum)
2. Changed below to reduce difficulties and keep it constant
   func CalcDifficulty(config *ChainConfig, time, parentTime uint64, parentNumber, parentDiff *big.Int) *big.Int {
   return big.NewInt(0x4000)
   }
3. Compiled using go 1.6
4. Setup a private net and accessing chain using web3 interface
   

   Backtrace

I0928 12:00:07.474790 cmd/utils/flags.go:678] You're one of the lucky few that will try out the JIT VM (random). If you get a consensus failure please be so kind to report this incident with the block hash that failed. You can switch to the regular VM by setting --jitvm=false
I0928 12:00:07.474864 ethdb/database.go:82] Alloted 128MB cache and 1024 file handles to /home/ubuntu/.ethereum/chaindata
I0928 12:00:07.484707 ethdb/database.go:169] closed db:/home/ubuntu/.ethereum/chaindata
I0928 12:00:07.485494 ethdb/database.go:82] Alloted 128MB cache and 1024 file handles to /home/ubuntu/.ethereum/chaindata
I0928 12:00:07.511395 ethdb/database.go:82] Alloted 16MB cache and 16 file handles to /home/ubuntu/.ethereum/dapp
I0928 12:00:07.514368 eth/backend.go:172] Protocol Versions: [63 62], Network Id: 1021
I0928 12:00:07.514489 eth/backend.go:201] Blockchain DB Version: 3
I0928 12:00:07.515811 core/blockchain.go:214] Last header: #29999 [00c611c1…] TD=491520000
I0928 12:00:07.515839 core/blockchain.go:215] Last block: #29999 [00c611c1…] TD=491520000
I0928 12:00:07.515850 core/blockchain.go:216] Fast block: #29999 [00c611c1…] TD=491520000
I0928 12:00:07.517255 p2p/server.go:313] Starting Server
I0928 12:00:07.517364 p2p/server.go:556] Listening on [::]:31113
I0928 12:00:07.518279 node/node.go:296] IPC endpoint opened: /home/ubuntu/LBG/geth.ipc
I0928 12:00:07.520973 node/node.go:366] HTTP endpoint opened: http://ec2-xx-xx-xx-xxx.xxxxxxx.compute.amazonaws.com:8545
I0928 12:00:11.324098 miner/miner.go:119] Starting mining operation (CPU=4 TOT=5)
I0928 12:00:11.324141 eth/backend.go:454] Automatic pregeneration of ethash DAG ON (ethash dir: /home/ubuntu/.ethash)
I0928 12:00:11.324595 miner/worker.go:573] commit new work on block 30000 with 0 txs & 0 uncles. Took 455.8µs
I0928 12:00:11.324664 ethash.go:259] Generating DAG for epoch 1 (size 1082130304) (290decd9548b62a8d60345a988386fc84ba6bc95484008f6362f93160ef3e563)
I0928 12:00:11.324975 eth/backend.go:461] checking DAG (ethash dir: /home/ubuntu/.ethash)
I0928 12:00:11.325035 eth/backend.go:475] Pregenerating DAG for epoch 1 (full-R23-290decd9548b62a8)
I0928 12:00:11.325060 ethash.go:259] Generating DAG for epoch 1 (size 1082130304) (290decd9548b62a8d60345a988386fc84ba6bc95484008f6362f93160ef3e563)
I0928 12:00:12.561561 ethash.go:291] Generating DAG: 0%
fatal error: unexpected signal during runtime execution
I0928 12:00:12.566224 ethash.go:291] Generating DAG: 0%
[signal 0x7 code=0x2 addr=0x7f25d8fc2cc8 pc=0xc69f2e]

runtime stack:
runtime.throw(0x11884c0, 0x2a)
/usr/local/go/src/runtime/panic.go:530 +0x90
runtime.sigpanic()
/usr/local/go/src/runtime/sigpanic_unix.go:12 +0x5a

goroutine 80 [syscall, locked to thread]:
runtime.cgocall(0xc67940, 0xc820ca38d0, 0x0)
/usr/local/go/src/runtime/cgocall.go:123 +0x11b fp=0xc820ca3860 sp=0xc820ca3830
github.com/ethereum/ethash._Cfunc_ethash_full_new_internal(0x7f26200008e0, 0xa8628b54d9ec0d29, 0xc86f3888a94503d6, 0xf608404895bca64b, 0x63e5f30e16932f36, 0x407fff80, 0x7f26200008c0, 0xc6b000, 0x0)
??:0 +0x45 fp=0xc820ca38d0 sp=0xc820ca3860
github.com/ethereum/ethash.(_dag).generate.func1()
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/ethereum/ethash/ethash.go:271 +0x529 fp=0xc820ca3a90 sp=0xc820ca38d0
sync.(_Once).Do(0xc8200994e0, 0xc820ca3ac8)
/usr/local/go/src/sync/once.go:44 +0xe4 fp=0xc820ca3ab8 sp=0xc820ca3a90
github.com/ethereum/ethash.(_dag).generate(0xc8200994c0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/ethereum/ethash/ethash.go:277 +0x45 fp=0xc820ca3ae0 sp=0xc820ca3ab8
github.com/ethereum/ethash.(_Full).getDAG(0xc820016990, 0x7530, 0xc8200994c0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/ethereum/ethash/ethash.go:333 +0xaa fp=0xc820ca3b10 sp=0xc820ca3ae0
github.com/ethereum/ethash.(_Full).Search(0xc820016990, 0x7f26309f6298, 0xc820c9c480, 0xc82009ad80, 0x3, 0x0, 0x0, 0x0, 0x0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/ethereum/ethash/ethash.go:338 +0x73 fp=0xc820ca3d70 sp=0xc820ca3b10
github.com/ethereum/go-ethereum/miner.(_CpuAgent).mine(0xc8200a46e0, 0xc820cc01a0, 0xc82009ad80)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/miner/agent.go:121 +0x1bc fp=0xc820ca3f88 sp=0xc820ca3d70
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1998 +0x1 fp=0xc820ca3f90 sp=0xc820ca3f88
created by github.com/ethereum/go-ethereum/miner.(*CpuAgent).update
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/miner/agent.go:90 +0x155

goroutine 1 [chan receive]:
github.com/ethereum/go-ethereum/node.(_Node).Wait(0xc820266a00)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/node/node.go:492 +0x93
main.geth(0xc8203f6dc0, 0x0, 0x0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/cmd/geth/main.go:272 +0xf2
reflect.Value.call(0xd56860, 0x12a9560, 0x13, 0xff8248, 0x4, 0xc820461b00, 0x1, 0x1, 0x0, 0x0, ...)
/usr/local/go/src/reflect/value.go:435 +0x120d
reflect.Value.Call(0xd56860, 0x12a9560, 0x13, 0xc820461b00, 0x1, 0x1, 0x0, 0x0, 0x0)
/usr/local/go/src/reflect/value.go:303 +0xb1
gopkg.in/urfave/cli%2ev1.HandleAction(0xd56860, 0x12a9560, 0xc8203f6dc0, 0x0, 0x0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/gopkg.in/urfave/cli.v1/app.go:480 +0x2ee
gopkg.in/urfave/cli%2ev1.(_App).Run(0xc82040e000, 0xc82000a420, 0x16, 0x16, 0x0, 0x0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/gopkg.in/urfave/cli.v1/app.go:241 +0xb05
main.main()
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/cmd/geth/main.go:240 +0x53

goroutine 17 [syscall, locked to thread]:
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1998 +0x1

goroutine 5 [select]:
github.com/ethereum/go-ethereum/logger.dispatchLoop()
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/logger/sys.go:81 +0x625
created by github.com/ethereum/go-ethereum/logger.init.1
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/logger/sys.go:60 +0x2b

goroutine 6 [chan receive]:
github.com/ethereum/go-ethereum/logger/glog.(*loggingT).flushDaemon(0x19f59a0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/logger/glog/glog.go:931 +0x67
created by github.com/ethereum/go-ethereum/logger/glog.init.1
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/logger/glog/glog.go:460 +0x6f

goroutine 34 [chan receive]:
github.com/rjeczalik/notify.(*nonrecursiveTree).dispatch(0xc8200b8120, 0xc8200b8060)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/rjeczalik/notify/tree_nonrecursive.go:36 +0x5c
created by github.com/rjeczalik/notify.newNonrecursiveTree
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/rjeczalik/notify/tree_nonrecursive.go:29 +0x21e

goroutine 35 [chan receive]:
github.com/rjeczalik/notify.(*nonrecursiveTree).internal(0xc8200b8120, 0xc8200b80c0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/rjeczalik/notify/tree_nonrecursive.go:81 +0x7b
created by github.com/rjeczalik/notify.newNonrecursiveTree
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/rjeczalik/notify/tree_nonrecursive.go:30 +0x24d

goroutine 71 [select]:
github.com/ethereum/go-ethereum/rpc.(*bufferedNotifier).run(0xc820098fc0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/rpc/notification.go:260 +0x529
created by github.com/ethereum/go-ethereum/rpc.newBufferedNotifier
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/rpc/notification.go:134 +0x126

goroutine 37 [syscall]:
os/signal.signal_recv(0x0)
/usr/local/go/src/runtime/sigqueue.go:116 +0x132
os/signal.loop()
/usr/local/go/src/os/signal/signal_unix.go:22 +0x18
created by os/signal.init.1
/usr/local/go/src/os/signal/signal_unix.go:28 +0x37

goroutine 38 [select, locked to thread]:
runtime.gopark(0x12a9e40, 0xc82010c728, 0x10025f0, 0x6, 0x18, 0x2)
/usr/local/go/src/runtime/proc.go:262 +0x163
runtime.selectgoImpl(0xc82010c728, 0x0, 0x18)
/usr/local/go/src/runtime/select.go:392 +0xa67
runtime.selectgo(0xc82010c728)
/usr/local/go/src/runtime/select.go:215 +0x12
runtime.ensureSigM.func1()
/usr/local/go/src/runtime/signal1_unix.go:279 +0x358
runtime.goexit()
/usr/local/go/src/runtime/asm_amd64.s:1998 +0x1

goroutine 9 [IO wait]:
net.runtime_pollWait(0x7f2635e4b3a8, 0x72, 0x0)
/usr/local/go/src/runtime/netpoll.go:160 +0x60
net.(_pollDesc).Wait(0xc8200560d0, 0x72, 0x0, 0x0)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x3a
net.(_pollDesc).WaitRead(0xc8200560d0, 0x0, 0x0)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x36
net.(_netFD).readFrom(0xc820056070, 0xc82000e820, 0xc, 0xc, 0x0, 0x0, 0x0, 0x7f2635e46050, 0xc82000e038)
/usr/local/go/src/net/fd_unix.go:277 +0x2a5
net.(_UDPConn).ReadFromUDP(0xc820028040, 0xc82000e820, 0xc, 0xc, 0x2, 0x0, 0x0, 0x0)
/usr/local/go/src/net/udpsock_posix.go:61 +0x117
github.com/jackpal/go-nat-pmp.(_Client).rpc(0xc82000d9a0, 0xc82003ae6e, 0x2, 0x2, 0xc, 0xc82000e820, 0xc, 0xc, 0x0, 0x0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/jackpal/go-nat-pmp/natpmp.go:138 +0x3d4
github.com/jackpal/go-nat-pmp.(_Client).GetExternalAddress(0xc82000d9a0, 0x0, 0x0, 0x0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/jackpal/go-nat-pmp/natpmp.go:62 +0xc1
github.com/ethereum/go-ethereum/p2p/nat.discoverPMP.func1(0xc82000e7a8, 0x4, 0x4, 0xc820060240)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/p2p/nat/natpmp.go:73 +0x87
created by github.com/ethereum/go-ethereum/p2p/nat.discoverPMP
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/p2p/nat/natpmp.go:78 +0x105

goroutine 70 [IO wait]:
net.runtime_pollWait(0x7f2635e4b228, 0x72, 0xc820cc2001)
/usr/local/go/src/runtime/netpoll.go:160 +0x60
net.(_pollDesc).Wait(0xc8203ac990, 0x72, 0x0, 0x0)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x3a
net.(_pollDesc).WaitRead(0xc8203ac990, 0x0, 0x0)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x36
net.(_netFD).Read(0xc8203ac930, 0xc820cc2001, 0x5ff, 0x5ff, 0x0, 0x7f2635e46050, 0xc82000e038)
/usr/local/go/src/net/fd_unix.go:250 +0x23a
net.(_conn).Read(0xc820028020, 0xc820cc2001, 0x5ff, 0x5ff, 0x0, 0x0, 0x0)
/usr/local/go/src/net/net.go:172 +0xe4
encoding/json.(_Decoder).refill(0xc8200b7a00, 0x0, 0x0)
/usr/local/go/src/encoding/json/stream.go:152 +0x287
encoding/json.(_Decoder).readValue(0xc8200b7a00, 0x1, 0x0, 0x0)
/usr/local/go/src/encoding/json/stream.go:128 +0x413
encoding/json.(_Decoder).Decode(0xc8200b7a00, 0xea7760, 0xc820226d00, 0x0, 0x0)
/usr/local/go/src/encoding/json/stream.go:57 +0x159
github.com/ethereum/go-ethereum/rpc.(_jsonCodec).ReadRequestHeaders(0xc8200a4460, 0x0, 0x0, 0x0, 0xceb500, 0x0, 0x0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/rpc/json.go:121 +0xfe
github.com/ethereum/go-ethereum/rpc.(_Server).readRequest(0xc820463c20, 0x7f26309f5fa8, 0xc8200a4460, 0x0, 0x0, 0x0, 0xc8200a4460, 0x0, 0x0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/rpc/server.go:390 +0x7b
github.com/ethereum/go-ethereum/rpc.(_Server).serveRequest(0xc820463c20, 0x7f26309f5fa8, 0xc8200a4460, 0x0, 0x3, 0x0, 0x0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/rpc/server.go:184 +0x52c
github.com/ethereum/go-ethereum/rpc.(_Server).ServeCodec(0xc820463c20, 0x7f26309f5fa8, 0xc8200a4460, 0x3)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/rpc/server.go:228 +0x73
created by github.com/ethereum/go-ethereum/node.(_Node).startIPC.func1
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/node/node.go:312 +0x37c

goroutine 51 [chan receive]:
github.com/rjeczalik/notify.(_inotify).send(0xc8200c2000, 0xc8200b82a0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/rjeczalik/notify/watcher_inotify.go:253 +0x6d
created by github.com/rjeczalik/notify.(_inotify).lazyinit
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/rjeczalik/notify/watcher_inotify.go:136 +0x25e

goroutine 52 [chan receive]:
github.com/rjeczalik/notify.(_inotify).send(0xc8200c2000, 0xc8200b82a0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/rjeczalik/notify/watcher_inotify.go:253 +0x6d
created by github.com/rjeczalik/notify.(_inotify).lazyinit
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/rjeczalik/notify/watcher_inotify.go:136 +0x25e

goroutine 46 [select]:
github.com/ethereum/go-ethereum/accounts.(_watcher).loop(0xc8203d5da0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/accounts/watch.go:91 +0x79b
created by github.com/ethereum/go-ethereum/accounts.(_watcher).start
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/accounts/watch.go:53 +0x52

goroutine 50 [syscall]:
syscall.Syscall6(0xe8, 0x5, 0xc82010df14, 0x1, 0xffffffffffffffff, 0x0, 0x0, 0x46d990, 0xc82026a0c0, 0x89160e)
/usr/local/go/src/syscall/asm_linux_amd64.s:44 +0x5
syscall.EpollWait(0x5, 0xc82010df14, 0x1, 0x1, 0xffffffffffffffff, 0xc8203fb320, 0x0, 0x0)
/usr/local/go/src/syscall/zsyscall_linux_amd64.go:365 +0x89
github.com/rjeczalik/notify.(_inotify).loop(0xc8200c2000, 0xc8200b82a0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/rjeczalik/notify/watcher_inotify.go:193 +0xca
created by github.com/rjeczalik/notify.(_inotify).lazyinit
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/rjeczalik/notify/watcher_inotify.go:133 +0x1ff

goroutine 53 [select]:
github.com/syndtr/goleveldb/leveldb.(*DB).compactionError(0xc82008e780)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/syndtr/goleveldb/leveldb/db_compaction.go:90 +0x54d
created by github.com/syndtr/goleveldb/leveldb.openDB
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/syndtr/goleveldb/leveldb/db.go:141 +0x6da

goroutine 47 [select]:
github.com/syndtr/goleveldb/leveldb/util.(*BufferPool).drain(0xc82046e0e0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/syndtr/goleveldb/leveldb/util/buffer_pool.go:206 +0x29e
created by github.com/syndtr/goleveldb/leveldb/util.NewBufferPool
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/syndtr/goleveldb/leveldb/util/buffer_pool.go:237 +0x270

goroutine 54 [select]:
github.com/syndtr/goleveldb/leveldb.(*DB).mpoolDrain(0xc82008e780)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/syndtr/goleveldb/leveldb/db_state.go:97 +0x14c
created by github.com/syndtr/goleveldb/leveldb.openDB
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/syndtr/goleveldb/leveldb/db.go:142 +0x6fc

goroutine 66 [select]:
github.com/syndtr/goleveldb/leveldb.(*DB).tCompaction(0xc82008e780)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/syndtr/goleveldb/leveldb/db_compaction.go:804 +0x816
created by github.com/syndtr/goleveldb/leveldb.openDB
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/syndtr/goleveldb/leveldb/db.go:148 +0x900

goroutine 67 [select]:
github.com/syndtr/goleveldb/leveldb.(*DB).mCompaction(0xc82008e780)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/syndtr/goleveldb/leveldb/db_compaction.go:751 +0x254
created by github.com/syndtr/goleveldb/leveldb.openDB
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/syndtr/goleveldb/leveldb/db.go:149 +0x922

goroutine 68 [select]:
github.com/syndtr/goleveldb/leveldb.(*DB).jWriter(0xc82008e780)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/syndtr/goleveldb/leveldb/db_write.go:37 +0x1a3
created by github.com/syndtr/goleveldb/leveldb.openDB
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/syndtr/goleveldb/leveldb/db.go:150 +0x944

goroutine 69 [select]:
github.com/syndtr/goleveldb/leveldb/util.(*BufferPool).drain(0xc82046e620)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/syndtr/goleveldb/leveldb/util/buffer_pool.go:206 +0x29e
created by github.com/syndtr/goleveldb/leveldb/util.NewBufferPool
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/syndtr/goleveldb/leveldb/util/buffer_pool.go:237 +0x270

goroutine 55 [select]:
github.com/syndtr/goleveldb/leveldb.(*DB).compactionError(0xc82040f980)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/syndtr/goleveldb/leveldb/db_compaction.go:90 +0x54d
created by github.com/syndtr/goleveldb/leveldb.openDB
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/syndtr/goleveldb/leveldb/db.go:141 +0x6da

goroutine 56 [select]:
github.com/syndtr/goleveldb/leveldb.(*DB).mpoolDrain(0xc82040f980)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/syndtr/goleveldb/leveldb/db_state.go:97 +0x14c
created by github.com/syndtr/goleveldb/leveldb.openDB
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/syndtr/goleveldb/leveldb/db.go:142 +0x6fc

goroutine 57 [select]:
github.com/syndtr/goleveldb/leveldb.(*DB).tCompaction(0xc82040f980)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/syndtr/goleveldb/leveldb/db_compaction.go:804 +0x816
created by github.com/syndtr/goleveldb/leveldb.openDB
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/syndtr/goleveldb/leveldb/db.go:148 +0x900

goroutine 58 [select]:
github.com/syndtr/goleveldb/leveldb.(*DB).mCompaction(0xc82040f980)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/syndtr/goleveldb/leveldb/db_compaction.go:751 +0x254
created by github.com/syndtr/goleveldb/leveldb.openDB
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/syndtr/goleveldb/leveldb/db.go:149 +0x922

goroutine 59 [select]:
github.com/syndtr/goleveldb/leveldb.(*DB).jWriter(0xc82040f980)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/syndtr/goleveldb/leveldb/db_write.go:37 +0x1a3
created by github.com/syndtr/goleveldb/leveldb.openDB
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/syndtr/goleveldb/leveldb/db.go:150 +0x944

goroutine 60 [select]:
github.com/ethereum/go-ethereum/core.(*BlockChain).update(0xc820240240)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/core/blockchain.go:1122 +0x102
created by github.com/ethereum/go-ethereum/core.NewBlockChain
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/core/blockchain.go:162 +0x10d8

goroutine 61 [chan receive]:
github.com/ethereum/go-ethereum/core.(*TxPool).eventLoop(0xc8200aabd0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/core/tx_pool.go:105 +0xd6
created by github.com/ethereum/go-ethereum/core.NewTxPool
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/core/tx_pool.go:94 +0x4b4

goroutine 62 [select]:
github.com/ethereum/go-ethereum/eth/downloader.(*Downloader).qosTuner(0xc8203c61c0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/eth/downloader/downloader.go:1443 +0x486
created by github.com/ethereum/go-ethereum/eth/downloader.New
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/eth/downloader/downloader.go:203 +0x110e

goroutine 63 [chan receive]:
github.com/ethereum/go-ethereum/miner.(*worker).update(0xc820240360)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/miner/worker.go:226 +0xad
created by github.com/ethereum/go-ethereum/miner.newWorker
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/miner/worker.go:150 +0x586

goroutine 64 [chan receive]:
github.com/ethereum/go-ethereum/miner.(*worker).wait(0xc820240360)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/miner/worker.go:260 +0x8e
created by github.com/ethereum/go-ethereum/miner.newWorker
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/miner/worker.go:152 +0x5a8

goroutine 65 [chan receive]:
github.com/ethereum/go-ethereum/miner.(*Miner).update(0xc820060660)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/miner/miner.go:68 +0x235
created by github.com/ethereum/go-ethereum/miner.New
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/miner/miner.go:56 +0x13d

goroutine 82 [chan receive]:
github.com/ethereum/go-ethereum/eth.(*PublicBlockChainAPI).subscriptionLoop(0xc8204114a0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/eth/api.go:549 +0x163
created by github.com/ethereum/go-ethereum/eth.NewPublicBlockChainAPI
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/eth/api.go:541 +0x18c

goroutine 83 [chan receive]:
github.com/ethereum/go-ethereum/eth.(*PublicTransactionPoolAPI).subscriptionLoop(0xc8200606c0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/eth/api.go:963 +0x12f
created by github.com/ethereum/go-ethereum/eth.NewPublicTransactionPoolAPI
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/eth/api.go:955 +0x218

goroutine 84 [IO wait]:
net.runtime_pollWait(0x7f2635e4b168, 0x72, 0x0)
/usr/local/go/src/runtime/netpoll.go:160 +0x60
net.(_pollDesc).Wait(0xc820273640, 0x72, 0x0, 0x0)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x3a
net.(_pollDesc).WaitRead(0xc820273640, 0x0, 0x0)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x36
net.(_netFD).accept(0xc8202735e0, 0x0, 0x7f26309f5d90, 0xc8202267c0)
/usr/local/go/src/net/fd_unix.go:426 +0x27c
net.(_TCPListener).AcceptTCP(0xc820468c20, 0x41e20b, 0x0, 0x0)
/usr/local/go/src/net/tcpsock_posix.go:254 +0x4d
net.(_TCPListener).Accept(0xc820468c20, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/net/tcpsock_posix.go:264 +0x3d
github.com/ethereum/go-ethereum/p2p.(_Server).listenLoop(0xc82040f200)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/p2p/server.go:579 +0x344
created by github.com/ethereum/go-ethereum/p2p.(*Server).startListening
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/p2p/server.go:382 +0x1c6

goroutine 85 [select]:
github.com/ethereum/go-ethereum/p2p/nat.Map(0x7f2635d0ea50, 0xc820426240, 0xc8200607e0, 0x10031e8, 0x3, 0x7989, 0x7989, 0x101dc10, 0xc)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/p2p/nat/nat.go:114 +0xa9d
github.com/ethereum/go-ethereum/p2p.(_Server).startListening.func1(0xc82040f200, 0xc820462d50)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/p2p/server.go:387 +0x8f
created by github.com/ethereum/go-ethereum/p2p.(_Server).startListening
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/p2p/server.go:389 +0x25c

goroutine 86 [select]:
github.com/ethereum/go-ethereum/p2p.(_Server).run(0xc82040f200, 0x7f2635e4d500, 0xc820273570)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/p2p/server.go:450 +0x198e
created by github.com/ethereum/go-ethereum/p2p.(_Server).Start
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/p2p/server.go:367 +0xd68

goroutine 87 [chan receive]:
github.com/ethereum/go-ethereum/eth.(_ProtocolManager).txBroadcastLoop(0xc8203d09c0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/eth/handler.go:747 +0x82
created by github.com/ethereum/go-ethereum/eth.(_ProtocolManager).Start
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/eth/handler.go:213 +0x11d

goroutine 88 [chan receive]:
github.com/ethereum/go-ethereum/eth.(_ProtocolManager).minedBroadcastLoop(0xc8203d09c0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/eth/handler.go:736 +0x86
created by github.com/ethereum/go-ethereum/eth.(_ProtocolManager).Start
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/eth/handler.go:216 +0x21a

goroutine 89 [select]:
github.com/ethereum/go-ethereum/eth.(_ProtocolManager).syncer(0xc8203d09c0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/eth/sync.go:140 +0x261
created by github.com/ethereum/go-ethereum/eth.(_ProtocolManager).Start
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/eth/handler.go:219 +0x23f

goroutine 90 [select]:
github.com/ethereum/go-ethereum/eth.(_ProtocolManager).txsyncLoop(0xc8203d09c0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/eth/sync.go:106 +0x5ff
created by github.com/ethereum/go-ethereum/eth.(_ProtocolManager).Start
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/eth/handler.go:220 +0x264

goroutine 91 [select]:
github.com/ethereum/go-ethereum/release.(_ReleaseService).checker(0xc820411810)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/release/release.go:106 +0x14c5
created by github.com/ethereum/go-ethereum/release.(_ReleaseService).Start
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/release/release.go:86 +0x41

goroutine 92 [chan receive]:
github.com/ethereum/go-ethereum/eth.(*PublicBlockChainAPI).subscriptionLoop(0xc820411900)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/eth/api.go:549 +0x163
created by github.com/ethereum/go-ethereum/eth.NewPublicBlockChainAPI
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/eth/api.go:541 +0x18c

goroutine 93 [chan receive]:
github.com/ethereum/go-ethereum/eth.(*PublicTransactionPoolAPI).subscriptionLoop(0xc820060cc0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/eth/api.go:963 +0x12f
created by github.com/ethereum/go-ethereum/eth.NewPublicTransactionPoolAPI
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/eth/api.go:955 +0x218

goroutine 94 [chan receive]:
github.com/ethereum/go-ethereum/eth/downloader.(*PublicDownloaderAPI).run(0xc8202c7100)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/eth/downloader/api.go:49 +0x243
created by github.com/ethereum/go-ethereum/eth/downloader.NewPublicDownloaderAPI
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/eth/downloader/api.go:41 +0xe4

goroutine 95 [chan receive]:
github.com/ethereum/go-ethereum/eth/filters.(*FilterSystem).filterLoop(0xc820060d80)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/eth/filters/filter_system.go:141 +0xd4
created by github.com/ethereum/go-ethereum/eth/filters.NewFilterSystem
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/eth/filters/filter_system.go:76 +0x4d5

goroutine 96 [select]:
github.com/ethereum/go-ethereum/eth/filters.(*PublicFilterAPI).start(0xc820204370)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/eth/filters/api.go:99 +0x8e0
created by github.com/ethereum/go-ethereum/eth/filters.NewPublicFilterAPI
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/eth/filters/api.go:84 +0x22a

goroutine 48 [select]:
github.com/ethereum/go-ethereum/eth/fetcher.(_Fetcher).loop(0xc8203d0b60)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/eth/fetcher/fetcher.go:316 +0x5bd7
created by github.com/ethereum/go-ethereum/eth/fetcher.(_Fetcher).Start
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/eth/fetcher/fetcher.go:178 +0x35

goroutine 97 [IO wait]:
net.runtime_pollWait(0x7f2635e4b0a8, 0x72, 0x0)
/usr/local/go/src/runtime/netpoll.go:160 +0x60
net.(_pollDesc).Wait(0xc8202736b0, 0x72, 0x0, 0x0)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x3a
net.(_pollDesc).WaitRead(0xc8202736b0, 0x0, 0x0)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x36
net.(_netFD).accept(0xc820273650, 0x0, 0x7f26309f5d90, 0xc820226a80)
/usr/local/go/src/net/fd_unix.go:426 +0x27c
net.(_UnixListener).AcceptUnix(0xc820c88940, 0xc820309ee0, 0x0, 0x0)
/usr/local/go/src/net/unixsock_posix.go:305 +0x53
net.(_UnixListener).Accept(0xc820c88940, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/net/unixsock_posix.go:315 +0x41
github.com/ethereum/go-ethereum/node.(_Node).startIPC.func1(0xc820266a00, 0x7f2635e516c0, 0xc820c88940, 0xc820463c20)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/node/node.go:299 +0x148
created by github.com/ethereum/go-ethereum/node.(*Node).startIPC
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/node/node.go:314 +0x425

goroutine 75 [select]:
github.com/ethereum/go-ethereum/miner.(_CpuAgent).update(0xc8200a46e0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/miner/agent.go:83 +0x2e4
created by github.com/ethereum/go-ethereum/miner.(_CpuAgent).Start
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/miner/agent.go:77 +0x13c

goroutine 100 [IO wait]:
net.runtime_pollWait(0x7f2635e4afe8, 0x72, 0x0)
/usr/local/go/src/runtime/netpoll.go:160 +0x60
net.(_pollDesc).Wait(0xc820273870, 0x72, 0x0, 0x0)
/usr/local/go/src/net/fd_poll_runtime.go:73 +0x3a
net.(_pollDesc).WaitRead(0xc820273870, 0x0, 0x0)
/usr/local/go/src/net/fd_poll_runtime.go:78 +0x36
net.(_netFD).accept(0xc820273810, 0x0, 0x7f26309f5d90, 0xc820c89740)
/usr/local/go/src/net/fd_unix.go:426 +0x27c
net.(_TCPListener).AcceptTCP(0xc820468cc8, 0x1, 0x0, 0x0)
/usr/local/go/src/net/tcpsock_posix.go:254 +0x4d
net.(_TCPListener).Accept(0xc820468cc8, 0x0, 0x0, 0x0, 0x0)
/usr/local/go/src/net/tcpsock_posix.go:264 +0x3d
net/http.(_Server).Serve(0xc820470f80, 0x7f2635e4d480, 0xc820468cc8, 0x0, 0x0)
/usr/local/go/src/net/http/server.go:2117 +0x129
created by github.com/ethereum/go-ethereum/node.(*Node).startHTTP
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/node/node.go:365 +0x646

goroutine 101 [chan receive]:
github.com/ethereum/go-ethereum/cmd/utils.StartNode.func1(0xc820266a00)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/cmd/utils/cmd.go:73 +0x12b
created by github.com/ethereum/go-ethereum/cmd/utils.StartNode
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/cmd/utils/cmd.go:84 +0x10d

goroutine 73 [syscall, locked to thread]:
github.com/ethereum/ethash._Cfunc_ethash_full_new_internal(0x7f261c000a10, 0xa8628b54d9ec0d29, 0xc86f3888a94503d6, 0xf608404895bca64b, 0x63e5f30e16932f36, 0x407fff80, 0x7f261c0008c0, 0xc6b000, 0x0)
??:0 +0x45
github.com/ethereum/ethash.(_dag).generate.func1()
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/ethereum/ethash/ethash.go:271 +0x529
sync.(_Once).Do(0xc8204405a0, 0xc820c9fc28)
/usr/local/go/src/sync/once.go:44 +0xe4
github.com/ethereum/ethash.(_dag).generate(0xc820440580)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/ethereum/ethash/ethash.go:277 +0x45
github.com/ethereum/ethash.MakeDAG(0x7530, 0x0, 0x0, 0x0, 0x0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/ethereum/ethash/ethash.go:303 +0x1f5
github.com/ethereum/go-ethereum/eth.(_Ethereum).StartAutoDAG.func1(0xc820240120)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/eth/backend.go:476 +0x9b8
created by github.com/ethereum/go-ethereum/eth.(*Ethereum).StartAutoDAG
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/eth/backend.go:491 +0x48

goroutine 76 [select]:
github.com/ethereum/go-ethereum/miner.(_RemoteAgent).maintainLoop(0xc820060d20)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/miner/remote_agent.go:156 +0x54e
created by github.com/ethereum/go-ethereum/miner.(_RemoteAgent).Start
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/miner/remote_agent.go:82 +0xe6

goroutine 77 [select]:
github.com/ethereum/go-ethereum/miner.(_CpuAgent).update(0xc8200a45f0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/miner/agent.go:83 +0x2e4
created by github.com/ethereum/go-ethereum/miner.(_CpuAgent).Start
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/miner/agent.go:77 +0x13c

goroutine 78 [select]:
github.com/ethereum/go-ethereum/miner.(_CpuAgent).update(0xc8200a4640)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/miner/agent.go:83 +0x2e4
created by github.com/ethereum/go-ethereum/miner.(_CpuAgent).Start
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/miner/agent.go:77 +0x13c

goroutine 79 [select]:
github.com/ethereum/go-ethereum/miner.(_CpuAgent).update(0xc8200a4690)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/miner/agent.go:83 +0x2e4
created by github.com/ethereum/go-ethereum/miner.(_CpuAgent).Start
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/miner/agent.go:77 +0x13c

goroutine 49 [semacquire]:
sync.runtime_Semacquire(0xc8200994e4)
/usr/local/go/src/runtime/sema.go:47 +0x26
sync.(_Mutex).Lock(0xc8200994e0)
/usr/local/go/src/sync/mutex.go:83 +0x1c4
sync.(_Once).Do(0xc8200994e0, 0xc82030bad8)
/usr/local/go/src/sync/once.go:40 +0x62
github.com/ethereum/ethash.(_dag).generate(0xc8200994c0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/ethereum/ethash/ethash.go:277 +0x45
github.com/ethereum/ethash.(_Full).getDAG(0xc820016990, 0x7530, 0xc8200994c0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/ethereum/ethash/ethash.go:333 +0xaa
github.com/ethereum/ethash.(_Full).Search(0xc820016990, 0x7f26309f6298, 0xc820c9c480, 0xc8202de480, 0x2, 0x0, 0x0, 0x0, 0x0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/ethereum/ethash/ethash.go:338 +0x73
github.com/ethereum/go-ethereum/miner.(_CpuAgent).mine(0xc8200a4690, 0xc820cc01a0, 0xc8202de480)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/miner/agent.go:121 +0x1bc
created by github.com/ethereum/go-ethereum/miner.(*CpuAgent).update
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/miner/agent.go:90 +0x155

goroutine 114 [semacquire]:
sync.runtime_Semacquire(0xc8200994e4)
/usr/local/go/src/runtime/sema.go:47 +0x26
sync.(_Mutex).Lock(0xc8200994e0)
/usr/local/go/src/sync/mutex.go:83 +0x1c4
sync.(_Once).Do(0xc8200994e0, 0xc820c92ad8)
/usr/local/go/src/sync/once.go:40 +0x62
github.com/ethereum/ethash.(_dag).generate(0xc8200994c0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/ethereum/ethash/ethash.go:277 +0x45
github.com/ethereum/ethash.(_Full).getDAG(0xc820016990, 0x7530, 0xc8200994c0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/ethereum/ethash/ethash.go:333 +0xaa
github.com/ethereum/ethash.(_Full).Search(0xc820016990, 0x7f26309f6298, 0xc820c9c480, 0xc8202de4e0, 0x0, 0x0, 0x0, 0x0, 0x0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/ethereum/ethash/ethash.go:338 +0x73
github.com/ethereum/go-ethereum/miner.(_CpuAgent).mine(0xc8200a45f0, 0xc820cc01a0, 0xc8202de4e0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/miner/agent.go:121 +0x1bc
created by github.com/ethereum/go-ethereum/miner.(*CpuAgent).update
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/miner/agent.go:90 +0x155

goroutine 115 [semacquire]:
sync.runtime_Semacquire(0xc8200994e4)
/usr/local/go/src/runtime/sema.go:47 +0x26
sync.(_Mutex).Lock(0xc8200994e0)
/usr/local/go/src/sync/mutex.go:83 +0x1c4
sync.(_Once).Do(0xc8200994e0, 0xc820c93ad8)
/usr/local/go/src/sync/once.go:40 +0x62
github.com/ethereum/ethash.(_dag).generate(0xc8200994c0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/ethereum/ethash/ethash.go:277 +0x45
github.com/ethereum/ethash.(_Full).getDAG(0xc820016990, 0x7530, 0xc8200994c0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/ethereum/ethash/ethash.go:333 +0xaa
github.com/ethereum/ethash.(_Full).Search(0xc820016990, 0x7f26309f6298, 0xc820c9c480, 0xc8202de540, 0x1, 0x0, 0x0, 0x0, 0x0)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/Godeps/_workspace/src/github.com/ethereum/ethash/ethash.go:338 +0x73
github.com/ethereum/go-ethereum/miner.(_CpuAgent).mine(0xc8200a4640, 0xc820cc01a0, 0xc8202de540)
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/miner/agent.go:121 +0x1bc
created by github.com/ethereum/go-ethereum/miner.(*CpuAgent).update
/home/ubuntu/go-ethereum/build/_workspace/src/github.com/ethereum/go-ethereum/miner/agent.go:90 +0x155

[karalabe]

How much memory does your machine have? Are you sure you're not running out? Generating the DAG requires quite a bit, and mining also.

[niladribhandari]

hi, Thank you for your response. I am using amazon ec2 m4.xlarge (8 GB ram) instance for my private chain. Please suggest if I need to double the RAM size.

[niladribhandari]

Hi, I am using m4.2xlarge instance of EC2. We have set difficulty as 0x40000

func CalcDifficulty(config *ChainConfig, time, parentTime uint64, parentNumber, parentDiff *big.Int) *big.Int {
return big.NewInt(0x40000)
}

Mining has stopped after 59999 block. when trying to restart mining it is crashing. Could you please suggest what could be the issue?

eth
{
accounts: ["0x1ae29983566dcd84c97c17b77ed97f1f124d6c5c", "0x368ecb4789aca5ebe884198a591d61bbc35c108d"],
blockNumber: 59999,
coinbase: "0x1ae29983566dcd84c97c17b77ed97f1f124d6c5c",
compile: {
lll: function(),
serpent: function(),
solidity: function()
},
defaultAccount: undefined,
defaultBlock: "latest",
gasPrice: 20000000000,
hashrate: 0,
mining: false,
pendingTransactions: [],
syncing: false,

[niladribhandari]

Now I am using geth version 1.4.15. It is now crashing after block 89999.

eth
{
accounts: ["0x1ae29983566dcd84c97c17b77ed97f1f124d6c5c", "0x368ecb4789aca5ebe884198a591d61bbc35c108d"],
blockNumber: 89999,
coinbase: "0x1ae29983566dcd84c97c17b77ed97f1f124d6c5c",
compile: {
lll: function(),
serpent: function(),
solidity: function()
},
defaultAccount: undefined,
defaultBlock: "latest",
gasPrice: 20000000000,
hashrate: 0,
mining: false,
pendingTransactions: [],
syncing: false,

[sharkfisher]

I'm using geth 1.4.18, and crashing at block 29998.

[sharkfisher]

this seems to be failing from ethereum/ethash/src/libethash/io.c, line
// file does not exist, will need to be created
f = ethash_fopen(tmpfile, "wb+");

Generating DAG: 0% went through the same code, and was fine - the file in .ethash was written to.
Generating DAG: 1% crashes on the above file opening for wb+, against the same file.
Was it crashing b/c the same file was locked/still used by the process of generating DAG 0%?

[ajayatgit]

I am also facing the same issue.

[SCBuergel]

There seem to be a ton of issue related to the this, I would call it a show stopper, e.g.:
https://github.com/ethereum/go-ethereum/issues/3628
https://github.com/ethereum/go-ethereum/issues/3583

[EliteCommander]

I am having the same issue on a server with 40 Threads and 128GB RAM

[karalabe]

@EliteCommander Please open a new issue with your details, this thread is very very old and was opened against a completely different code base. Closing it as the entire code was replaced.