[Decoder]: Using assembly version of decoder [Sentry] 2020/07/30 05:54:10 Integration installed: ContextifyFrames [Sentry] 2020/07/30 05:54:10 Integration installed: Environment [Sentry] 2020/07/30 05:54:10 Integration installed: Modules [Sentry] 2020/07/30 05:54:10 Integration installed: IgnoreErrors [Decoder]: Using assembly version of decoder [Sentry] 2020/07/30 05:54:10 Integration installed: ContextifyFrames [Sentry] 2020/07/30 05:54:10 Integration installed: Environment [Sentry] 2020/07/30 05:54:10 Integration installed: Modules [Sentry] 2020/07/30 05:54:10 Integration installed: IgnoreErrors I0730 05:54:10.571976 12 init.go:99] Dgraph version : v20.03.1 Dgraph SHA-256 : 6a40b1e084205ae9e29336780b3458a3869db45c0b96b916190881c16d705ba8 Commit SHA-1 : c201611d6 Commit timestamp : 2020-04-24 13:53:41 -0700 Branch : HEAD Go version : go1.14.1 For Dgraph official documentation, visit https://docs.dgraph.io. For discussions about Dgraph , visit https://discuss.dgraph.io. To say hi to the community , visit https://dgraph.slack.com. Licensed variously under the Apache Public License 2.0 and Dgraph Community License. Copyright 2015-2020 Dgraph Labs, Inc. I0730 05:54:10.573397 12 run.go:108] Setting up grpc listener at: 0.0.0.0:5080 I0730 05:54:10.573961 12 run.go:108] Setting up http listener at: 0.0.0.0:6080 badger 2020/07/30 05:54:10 INFO: All 0 tables opened in 0s I0730 05:54:10.599096 12 node.go:148] Setting raft.Config to: &{ID:1 peers:[] learners:[] ElectionTick:20 HeartbeatTick:1 Storage:0xc00032c2c0 Applied:0 MaxSizePerMsg:262144 MaxCommittedSizePerReady:67108864 MaxUncommittedEntriesSize:0 MaxInflightMsgs:256 CheckQuorum:false PreVote:true ReadOnlyOption:0 Logger:0x282e510 DisableProposalForwarding:false} I0730 05:54:10.599368 12 node.go:326] Group 0 found 0 entries I0730 05:54:10.599433 12 log.go:34] 1 became follower at term 0 I0730 05:54:10.599463 12 log.go:34] newRaft 1 [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0] I0730 05:54:10.599470 12 log.go:34] 1 became follower at term 1 I0730 05:54:10.599556 12 run.go:307] Running Dgraph Zero... E0730 05:54:10.599585 12 storage.go:97] deleteRange failed with error: requested index is unavailable due to compaction, from: 0, until: 0 E0730 05:54:10.600718 12 raft.go:516] While proposing CID: Not Zero leader. Aborting proposal: cid:"65550ea9-e64a-45d7-975d-2f4b18fc67c1" . Retrying... I0730 05:54:10.602795 12 node.go:185] Setting conf state to nodes:1 I0730 05:54:10.602849 12 raft.go:702] Done applying conf change at 0x1 I0730 05:54:10.689952 12 zero.go:417] Got connection request: cluster_info_only:true I0730 05:54:10.690079 12 log.go:34] 1 no leader at term 1; dropping index reading msg W0730 05:54:12.690110 12 node.go:674] [0x1] Read index context timed out I0730 05:54:12.690168 12 log.go:34] 1 no leader at term 1; dropping index reading msg E0730 05:54:13.600947 12 raft.go:516] While proposing CID: Not Zero leader. Aborting proposal: cid:"7c1743a9-4550-410c-ace5-2bb5d0b61d77" . Retrying... I0730 05:54:14.000518 12 log.go:34] 1 is starting a new election at term 1 I0730 05:54:14.001407 12 log.go:34] 1 became pre-candidate at term 1 I0730 05:54:14.001961 12 log.go:34] 1 received MsgPreVoteResp from 1 at term 1 I0730 05:54:14.002477 12 log.go:34] 1 became candidate at term 2 I0730 05:54:14.002923 12 log.go:34] 1 received MsgVoteResp from 1 at term 2 I0730 05:54:14.003582 12 log.go:34] 1 became leader at term 2 I0730 05:54:14.004415 12 log.go:34] raft.node: 1 elected leader 1 at term 2 I0730 05:54:14.005428 12 raft.go:667] I've become the leader, updating leases. I0730 05:54:14.005951 12 assign.go:42] Updated Lease id: 1. Txn Ts: 1 W0730 05:54:14.690430 12 node.go:674] [0x1] Read index context timed out I0730 05:54:14.691975 12 zero.go:435] Connected: cluster_info_only:true I0730 05:54:14.692988 12 zero.go:417] Got connection request: cluster_info_only:true I0730 05:54:14.694438 12 zero.go:435] Connected: cluster_info_only:true I0730 05:54:14.695682 12 zero.go:417] Got connection request: cluster_info_only:true I0730 05:54:14.696492 12 zero.go:435] Connected: cluster_info_only:true I0730 05:54:14.696603 12 zero.go:417] Got connection request: id:1 addr:"10.50.34.90:7080" I0730 05:54:14.698437 12 pool.go:160] CONNECTING to 10.50.34.90:7080 I0730 05:54:14.701870 12 zero.go:562] Connected: id:1 group_id:1 addr:"10.50.34.90:7080" I0730 05:54:14.701977 12 zero.go:417] Got connection request: id:2 addr:"10.50.34.90:7081" I0730 05:54:14.702165 12 pool.go:160] CONNECTING to 10.50.34.90:7081 W0730 05:54:14.703418 12 pool.go:254] Connection lost with 10.50.34.90:7080. Error: rpc error: code = Unknown desc = No node has been set up yet W0730 05:54:14.706900 12 pool.go:254] Connection lost with 10.50.34.90:7081. Error: rpc error: code = Unknown desc = No node has been set up yet I0730 05:54:14.709139 12 zero.go:562] Connected: id:2 group_id:1 addr:"10.50.34.90:7081" I0730 05:54:14.709403 12 zero.go:417] Got connection request: id:3 addr:"10.50.34.90:7082" I0730 05:54:14.709612 12 pool.go:160] CONNECTING to 10.50.34.90:7082 I0730 05:54:14.716644 12 zero.go:562] Connected: id:3 group_id:1 addr:"10.50.34.90:7082" W0730 05:54:14.716991 12 pool.go:254] Connection lost with 10.50.34.90:7082. Error: rpc error: code = Unknown desc = No node has been set up yet I0730 05:54:14.717290 12 zero.go:417] Got connection request: cluster_info_only:true I0730 05:54:14.719048 12 zero.go:435] Connected: cluster_info_only:true I0730 05:54:14.721630 12 zero.go:417] Got connection request: cluster_info_only:true I0730 05:54:14.722238 12 zero.go:435] Connected: cluster_info_only:true I0730 05:54:16.604365 12 raft.go:509] CID set for cluster: d6fec2d9-89a6-409d-a7b1-8d7871c7247d I0730 05:54:16.606454 12 license_ee.go:45] Enterprise state proposed to the cluster: key:"z1-12164582800675724733" license: I0730 05:54:35.824965 12 zero.go:417] Got connection request: cluster_info_only:true I0730 05:54:35.825189 12 zero.go:435] Connected: cluster_info_only:true I0730 05:54:35.826261 12 zero.go:417] Got connection request: id:5 addr:"10.50.34.68:7081" I0730 05:54:35.826699 12 pool.go:160] CONNECTING to 10.50.34.68:7081 W0730 05:54:35.828040 12 pool.go:254] Connection lost with 10.50.34.68:7081. Error: rpc error: code = Unknown desc = No node has been set up yet I0730 05:54:35.829205 12 zero.go:562] Connected: id:5 group_id:2 addr:"10.50.34.68:7081" I0730 05:54:35.887353 12 zero.go:417] Got connection request: cluster_info_only:true I0730 05:54:35.887801 12 zero.go:435] Connected: cluster_info_only:true I0730 05:54:35.888922 12 zero.go:417] Got connection request: id:4 addr:"10.50.34.68:7080" I0730 05:54:35.889431 12 pool.go:160] CONNECTING to 10.50.34.68:7080 W0730 05:54:35.890660 12 pool.go:254] Connection lost with 10.50.34.68:7080. Error: rpc error: code = Unknown desc = No node has been set up yet I0730 05:54:35.891969 12 zero.go:562] Connected: id:4 group_id:2 addr:"10.50.34.68:7080" I0730 05:54:35.924126 12 zero.go:417] Got connection request: cluster_info_only:true I0730 05:54:35.924591 12 zero.go:435] Connected: cluster_info_only:true I0730 05:54:35.926489 12 zero.go:417] Got connection request: id:6 addr:"10.50.34.68:7082" I0730 05:54:35.926862 12 pool.go:160] CONNECTING to 10.50.34.68:7082 W0730 05:54:35.928640 12 pool.go:254] Connection lost with 10.50.34.68:7082. Error: rpc error: code = Unknown desc = No node has been set up yet I0730 05:54:35.929567 12 zero.go:562] Connected: id:6 group_id:2 addr:"10.50.34.68:7082" I0730 06:02:10.600290 12 tablet.go:208] Groups sorted by size: [{gid:1 size:0} {gid:2 size:0}] I0730 06:02:10.600360 12 tablet.go:213] size_diff 0 I0730 06:10:10.600219 12 tablet.go:208] Groups sorted by size: [{gid:1 size:0} {gid:2 size:0}] I0730 06:10:10.600324 12 tablet.go:213] size_diff 0 I0730 06:18:10.600344 12 tablet.go:208] Groups sorted by size: [{gid:1 size:0} {gid:2 size:0}] I0730 06:18:10.600949 12 tablet.go:213] size_diff 0 I0730 06:26:10.600326 12 tablet.go:208] Groups sorted by size: [{gid:1 size:0} {gid:2 size:0}] I0730 06:26:10.600380 12 tablet.go:213] size_diff 0 I0730 06:34:10.600285 12 tablet.go:208] Groups sorted by size: [{gid:1 size:0} {gid:2 size:0}] I0730 06:34:10.600316 12 tablet.go:213] size_diff 0 I0730 06:42:10.600341 12 tablet.go:208] Groups sorted by size: [{gid:1 size:0} {gid:2 size:0}] I0730 06:42:10.600466 12 tablet.go:213] size_diff 0 I0730 06:49:25.795931 12 oracle.go:107] Purged below ts:0, len(o.commits):3743, len(o.rowCommit):12482 W0730 06:49:25.796011 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 1.089s. Breakdown: [{sync 1.089s} {proposals 1ms} {disk 0s} {advance 0s}]. Num entries: 1. MustSync: true I0730 06:50:10.600301 12 tablet.go:208] Groups sorted by size: [{gid:1 size:0} {gid:2 size:0}] I0730 06:50:10.600333 12 tablet.go:213] size_diff 0 I0730 06:50:43.834802 12 oracle.go:107] Purged below ts:11552, len(o.commits):2646, len(o.rowCommit):8838 I0730 06:50:50.600736 12 raft.go:616] Writing snapshot at index: 3457, applied mark: 6317 I0730 06:51:15.710751 12 oracle.go:107] Purged below ts:19544, len(o.commits):1263, len(o.rowCommit):4228 I0730 06:51:20.600809 12 raft.go:616] Writing snapshot at index: 5858, applied mark: 7284 W0730 06:53:12.183988 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 1.222s. Breakdown: [{sync 1.221s} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true I0730 06:53:16.709432 12 oracle.go:107] Purged below ts:19544, len(o.commits):5006, len(o.rowCommit):16710 I0730 06:53:39.834720 12 oracle.go:107] Purged below ts:35999, len(o.commits):796, len(o.rowCommit):2666 I0730 06:53:40.600950 12 raft.go:616] Writing snapshot at index: 10804, applied mark: 11628 I0730 06:54:02.742074 12 zero.go:417] Got connection request: cluster_info_only:true I0730 06:54:02.742874 12 zero.go:435] Connected: cluster_info_only:true I0730 06:55:16.710427 12 oracle.go:107] Purged below ts:38206, len(o.commits):3092, len(o.rowCommit):10325 I0730 06:56:46.835197 12 oracle.go:107] Purged below ts:48395, len(o.commits):2959, len(o.rowCommit):9879 I0730 06:56:50.600717 12 raft.go:616] Writing snapshot at index: 14529, applied mark: 17555 I0730 06:57:17.712280 12 oracle.go:107] Purged below ts:57086, len(o.commits):1205, len(o.rowCommit):4033 I0730 06:57:20.600775 12 raft.go:616] Writing snapshot at index: 17140, applied mark: 18444 I0730 06:58:10.600283 12 tablet.go:208] Groups sorted by size: [{gid:1 size:0} {gid:2 size:0}] I0730 06:58:10.600767 12 tablet.go:213] size_diff 0 I0730 06:58:46.399180 12 zero.go:417] Got connection request: cluster_info_only:true I0730 06:58:46.401514 12 zero.go:435] Connected: cluster_info_only:true I0730 06:59:18.300957 12 oracle.go:107] Purged below ts:57086, len(o.commits):5003, len(o.rowCommit):16703 I0730 06:59:42.836556 12 oracle.go:107] Purged below ts:73418, len(o.commits):880, len(o.rowCommit):2951 I0730 06:59:50.600771 12 raft.go:616] Writing snapshot at index: 22049, applied mark: 23156 I0730 07:01:17.709647 12 oracle.go:107] Purged below ts:75551, len(o.commits):2924, len(o.rowCommit):9762 I0730 07:02:38.837242 12 oracle.go:107] Purged below ts:84976, len(o.commits):2605, len(o.rowCommit):8703 I0730 07:02:40.600695 12 raft.go:616] Writing snapshot at index: 25522, applied mark: 28188 I0730 07:03:18.711286 12 oracle.go:107] Purged below ts:93322, len(o.commits):1385, len(o.rowCommit):4632 I0730 07:03:20.600700 12 raft.go:616] Writing snapshot at index: 28031, applied mark: 29481 W0730 07:04:48.093661 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 1.155s. Breakdown: [{sync 1.154s} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true I0730 07:05:18.710599 12 oracle.go:107] Purged below ts:93322, len(o.commits):5146, len(o.rowCommit):17173 I0730 07:05:44.837335 12 oracle.go:107] Purged below ts:110038, len(o.commits):917, len(o.rowCommit):3077 I0730 07:05:50.601073 12 raft.go:616] Writing snapshot at index: 33054, applied mark: 34165 I0730 07:06:10.600205 12 tablet.go:208] Groups sorted by size: [{gid:1 size:0} {gid:2 size:0}] I0730 07:06:10.600244 12 tablet.go:213] size_diff 0 I0730 07:07:18.710177 12 oracle.go:107] Purged below ts:112099, len(o.commits):2743, len(o.rowCommit):9159 I0730 07:08:40.888096 12 oracle.go:107] Purged below ts:120785, len(o.commits):2529, len(o.rowCommit):8447 W0730 07:08:43.305366 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 257ms. Breakdown: [{sync 257ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true I0730 07:08:50.600875 12 raft.go:616] Writing snapshot at index: 36286, applied mark: 38854 W0730 07:10:47.506008 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 368ms. Breakdown: [{sync 368ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:11:01.586257 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 278ms. Breakdown: [{sync 278ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:11:04.046130 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 468ms. Breakdown: [{sync 468ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:11:14.947586 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 248ms. Breakdown: [{sync 248ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:11:19.216419 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 575ms. Breakdown: [{sync 575ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:11:21.417636 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 229ms. Breakdown: [{sync 229ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:11:22.577614 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 247ms. Breakdown: [{sync 247ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:11:23.787679 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 267ms. Breakdown: [{sync 266ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:11:25.411125 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 230ms. Breakdown: [{sync 230ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:11:26.816333 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 387ms. Breakdown: [{sync 387ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:11:27.906348 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 257ms. Breakdown: [{sync 257ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:11:30.258093 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 248ms. Breakdown: [{sync 248ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:11:33.087286 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 247ms. Breakdown: [{sync 247ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:11:34.446501 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 357ms. Breakdown: [{sync 357ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:11:52.496518 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 747ms. Breakdown: [{sync 747ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:11:56.366487 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 248ms. Breakdown: [{sync 248ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:11:58.067340 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 207ms. Breakdown: [{sync 207ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:11:59.876625 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 248ms. Breakdown: [{sync 248ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:12:01.326580 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 316ms. Breakdown: [{sync 316ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:12:09.286558 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 608ms. Breakdown: [{sync 608ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:12:12.178590 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 220ms. Breakdown: [{sync 219ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:12:13.727885 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 247ms. Breakdown: [{sync 247ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:12:15.078031 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 229ms. Breakdown: [{sync 229ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:12:18.878352 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 247ms. Breakdown: [{sync 247ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:12:20.099138 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 247ms. Breakdown: [{sync 247ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:12:21.546702 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 255ms. Breakdown: [{sync 255ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:12:23.117109 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 378ms. Breakdown: [{sync 378ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:12:25.117689 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 250ms. Breakdown: [{sync 201ms} {disk 49ms} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:12:29.916714 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 265ms. Breakdown: [{sync 265ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:12:31.098492 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 277ms. Breakdown: [{sync 277ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:12:32.328765 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 230ms. Breakdown: [{sync 230ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:12:34.726718 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 257ms. Breakdown: [{sync 257ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:12:36.948563 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 216ms. Breakdown: [{sync 216ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:12:37.918173 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 248ms. Breakdown: [{sync 248ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:12:41.006704 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 358ms. Breakdown: [{sync 358ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:12:42.087956 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 228ms. Breakdown: [{sync 228ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:12:45.476842 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 376ms. Breakdown: [{sync 376ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:12:48.158558 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 229ms. Breakdown: [{sync 229ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:12:49.237942 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 248ms. Breakdown: [{sync 247ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:12:50.696869 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 355ms. Breakdown: [{sync 355ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:12:51.946802 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 347ms. Breakdown: [{sync 347ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:12:53.098149 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 247ms. Breakdown: [{sync 247ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:12:54.387962 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 247ms. Breakdown: [{sync 247ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:12:55.978103 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 248ms. Breakdown: [{sync 248ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:12:57.556932 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 256ms. Breakdown: [{sync 256ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:12:58.608289 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 248ms. Breakdown: [{sync 248ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:13:01.218173 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 239ms. Breakdown: [{sync 239ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:13:02.807153 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 317ms. Breakdown: [{sync 317ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:13:04.168422 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 217ms. Breakdown: [{sync 217ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:13:05.248412 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 208ms. Breakdown: [{sync 208ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:13:06.767184 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 385ms. Breakdown: [{sync 385ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:13:08.348606 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 247ms. Breakdown: [{sync 247ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:13:09.618109 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 227ms. Breakdown: [{sync 227ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:13:11.398697 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 248ms. Breakdown: [{sync 248ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:13:12.538299 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 247ms. Breakdown: [{sync 247ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:13:14.767023 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 255ms. Breakdown: [{sync 255ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:13:14.969751 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 202ms. Breakdown: [{sync 202ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:13:16.318656 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 217ms. Breakdown: [{sync 217ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:13:17.498335 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 248ms. Breakdown: [{sync 248ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:13:19.036975 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 406ms. Breakdown: [{sync 406ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:13:20.718441 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 244ms. Breakdown: [{sync 244ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:13:22.097040 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 237ms. Breakdown: [{sync 237ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:13:23.439146 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 248ms. Breakdown: [{sync 248ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:13:24.967062 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 264ms. Breakdown: [{sync 264ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:13:26.497052 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 396ms. Breakdown: [{sync 396ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:13:28.237418 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 508ms. Breakdown: [{sync 508ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:13:29.808973 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 268ms. Breakdown: [{sync 268ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:13:30.998613 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 247ms. Breakdown: [{sync 247ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:13:32.377269 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 265ms. Breakdown: [{sync 265ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:13:33.618590 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 267ms. Breakdown: [{sync 267ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:13:35.008639 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 248ms. Breakdown: [{sync 248ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:13:37.617165 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 297ms. Breakdown: [{sync 296ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:13:42.277889 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 217ms. Breakdown: [{sync 217ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:13:42.917244 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 237ms. Breakdown: [{sync 237ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:13:46.169375 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 250ms. Breakdown: [{sync 250ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:13:55.068611 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 247ms. Breakdown: [{sync 246ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:13:56.339358 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 247ms. Breakdown: [{sync 247ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:13:58.308603 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 276ms. Breakdown: [{sync 275ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:14:00.177297 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 428ms. Breakdown: [{sync 428ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:14:01.848995 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 229ms. Breakdown: [{sync 228ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:14:03.342043 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 248ms. Breakdown: [{sync 248ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:14:04.917236 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 278ms. Breakdown: [{sync 277ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true I0730 07:14:10.600193 12 tablet.go:208] Groups sorted by size: [{gid:1 size:0} {gid:2 size:0}] I0730 07:14:10.600233 12 tablet.go:213] size_diff 0 I0730 07:14:15.759243 12 oracle.go:107] Purged below ts:129145, len(o.commits):874, len(o.rowCommit):2926 I0730 07:14:20.600695 12 raft.go:616] Writing snapshot at index: 38796, applied mark: 39695 W0730 07:14:33.537442 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 416ms. Breakdown: [{sync 416ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:15:12.387799 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 466ms. Breakdown: [{sync 465ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:16:04.938109 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 388ms. Breakdown: [{sync 388ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:17:17.998518 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 358ms. Breakdown: [{sync 358ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:19:48.629729 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 228ms. Breakdown: [{sync 228ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:20:51.299913 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 548ms. Breakdown: [{sync 548ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:21:01.580032 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 248ms. Breakdown: [{sync 248ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:21:22.340017 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 237ms. Breakdown: [{sync 237ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:21:53.310597 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 238ms. Breakdown: [{sync 238ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:22:03.690383 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 228ms. Breakdown: [{sync 228ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true I0730 07:22:10.600324 12 tablet.go:208] Groups sorted by size: [{gid:1 size:0} {gid:2 size:0}] I0730 07:22:10.601121 12 tablet.go:213] size_diff 0 I0730 07:27:25.773166 12 oracle.go:107] Purged below ts:129145, len(o.commits):3983, len(o.rowCommit):13294 I0730 07:28:39.885524 12 oracle.go:107] Purged below ts:142264, len(o.commits):336, len(o.rowCommit):1135 I0730 07:28:40.600635 12 raft.go:616] Writing snapshot at index: 42740, applied mark: 43081 W0730 07:30:05.214881 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 219ms. Breakdown: [{sync 219ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true I0730 07:30:10.600250 12 tablet.go:208] Groups sorted by size: [{gid:1 size:0} {gid:2 size:0}] I0730 07:30:10.600297 12 tablet.go:213] size_diff 0 W0730 07:33:21.584653 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 238ms. Breakdown: [{sync 238ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true W0730 07:34:49.865018 12 raft.go:733] Raft.Ready took too long to process: Timer Total: 317ms. Breakdown: [{sync 317ms} {disk 0s} {proposals 0s} {advance 0s}]. Num entries: 1. MustSync: true