Add integration test for snapshotting.

Change-Id: Ia5f32194dd37b8136670378178ae8a5555b79335
Signed-off-by: Jay Guo <guojiannan1101@gmail.com>

This CR wires BlockPuller to chain and adds SnapshotInterval
to etcdraft config options.

Change-Id: Ib8420f94d70bd36fc2ab3c66450926a574c4f69d
Signed-off-by: Jay Guo <guojiannan1101@gmail.com>

This CR adds enables etcd/raft based chain to take snapshot for
every `SnapInterval` blocks. It stores snapshot to wal and disk.
When node restarts, it loads latest snapshot and uses Term and
Index stored in it to replay WAL to memory storage.

Change-Id: Ib8c22173cd5b05b7a1b27b16e2003bdabbecf82a
Signed-off-by: Jay Guo <guojiannan1101@gmail.com>

Change-Id: I55294754a643f644aa5a15e1b8ce88117cc9f651
Signed-off-by: waels <wael.shama@ibm.com>

"[FAB-11640]: fix and modify to RWMutex"

Change-Id: I55294754a643f644aa5a15e1b8ce88117cc9f651
Signed-off-by: waels <wael.shama@ibm.com>

[FAB-11640]: modify to use atomic operations

Change-Id: I55294754a643f644aa5a15e1b8ce88117cc9f651
Signed-off-by: waels <wael.shama@ibm.com>

Document that node and java chaincode installation takes absolute path.

Change-Id: I3acde0ec7c9c5c72c6abdaec8d4c20fe59ae2da1
Signed-off-by: David Enyeart <enyeart@us.ibm.com>

Change-Id: Idb9f5aa3fd0067998a732c81f8f87c7fb02e165b
Signed-off-by: Matthew Sykes <sykesmat@us.ibm.com>

Change-Id: I12e8b60c0b21ce7f7a7d33e899729229a6cd9c37
Signed-off-by: Matthew Sykes <sykesmat@us.ibm.com>

* changes:
  [FAB-12901] regenerate fakes in core/chaincode
  Instrument metrics into chaincode handler

This change set implements logic for pulling all needed chains
the newly joined orderer is part of.

It adds a Replicator struct which has the following methods:
- IsReplicationNeeded: Expected to run at boot time to decide whether
  to actiate the onboarding code or skip to resume normal boot.
- ReplicateChains: Orchestrates replication of all (needed) chains by
  iterating the system channel and inspecting all channel creation
  transactions (by using previously code in past commits),
  and calling PullChannel on each needed channel.
- PullChannel: Pulls a channel and commits the blocks to the ledger.

Unit tests with full code coverage are included.

Change-Id: Ice450f5702e6316e8f3aa9aabdeb952749a9ff66
Signed-off-by: yacovm <yacovm@il.ibm.com>

Change-Id: I01d08c000eb8ba804197267734adf515e42e6563
Signed-off-by: Matthew Sykes <sykesmat@us.ibm.com>

Currently, gossip constructs pvtData only for validTx
as per VSCC. Hence, we are not storing all pvtData of
a block.

In the ledger, currently, we are storing pvtData of
invalidTx (i.e., failed MVCC checks) too. To be
consistent, this CR can stores the pvtData of only
validTx (as per MVCC check).

FAB-11805 #done

Change-Id: Ic4b228cade0456bc1ddc4ab80595e9e82d7aaa25
Signed-off-by: senthil <cendhu@gmail.com>

Adds metrics for transactions received, completed,
and transaction duration.

FAB-12797 #done

Change-Id: I4bd48ed57e37e2be8ac95319a996889d61fa09e2
Signed-off-by: Will Lahti <wtlahti@us.ibm.com>
Signed-off-by: Matthew Sykes <sykesmat@us.ibm.com>

Label values for certain metrics may contain characters that are not
allowed by the statsd wire protocol. This CR adds sanitizes label values
in the statsd namer by replacing invalid characters with an underscore.

FAB-12811 #done

Change-Id: I92fb4b0b37b2e8e0446c622a4b1ee043c11bb9de
Signed-off-by: Will Lahti <wtlahti@us.ibm.com>
Signed-off-by: Matthew Sykes <sykesmat@us.ibm.com>

- Remove timeouts on contexts where we aren't checking for deadline
  related logs
- Extend timeout on contexts where we are checking for deadline related
  logs
- Wait for the desired number of log records before performing
  assertions

Change-Id: Ieb9d46fe959686667db149392617382cc1846599
Signed-off-by: Matthew Sykes <sykesmat@us.ibm.com>

Change-Id: I7d3aaaa10191fb47aa4513fbb7ea52d62e2fa622
Signed-off-by: Matthew Sykes <sykesmat@us.ibm.com>

Client certificate is required for logging and metrics when TLS enabled.
Client certificate is not required for healthz when TLS enabled.
Client certificate always required when RequireClientCert is true

Change-Id: I462647f0907efc2aaae9f1e9e6d2d3207da3ee57
Signed-off-by: Matthew Sykes <sykesmat@us.ibm.com>

FAB-12717 #done
FAB-12720 #done

Change-Id: I29da1e50a46edf7e889c12709012cdcb63f949ef
Signed-off-by: Matthew Sykes <sykesmat@us.ibm.com>

Collect information about all of the currently executing go routines
within a process by handling SIGUSR1. SIGUSR1 will not terminate the
process.

Change-Id: Ide5a26a8f1ee9bae93d3c6ba4b0b178661cbfd6c
Signed-off-by: Saad Karim <skarim@us.ibm.com>
Signed-off-by: Matthew Sykes <sykesmat@us.ibm.com>

Change-Id: I79a199f192370c8153b3e32485aa11215332edb8
Signed-off-by: Matthew Sykes <sykesmat@us.ibm.com>

An in-memory keystore for BCCSP to remove the need to put key
material into persistent storage.

Change-Id: I8c66dd28298c6af1cad4cf44b84474018af51e6c
Signed-off-by: Matthias Neugschwandtner <eug@zurich.ibm.com>

The MSP claims "CA Certificate did not have the Subject Key Identifier
extension, (SN: %s)" whenever a certificate does not have an SKI set or
when the certificate does not have the "IsCA" attribute set. In the latter
case, it is very confusing to the user because when they inspect the
certificate the SKI will indeed be present while the error indicates
otherwise.

Additionally, the error prints the cert serial number as decimal, which is
very unhelpful because tools typically report the serial number as hex.

Change-Id: I4cdc0b33d39617e108adaa5999669a6599dd9999
Signed-off-by: Jason Yellick <jyellick@us.ibm.com>

For any internal usage, it is good to have map so that lookup and
comparison code can be written with lesser lines of codes. If the
order of the stored entries do not matter, then slice is not needed
and adds a lot of complexity during lookups.

Given above, this CR changes the slice used for missingData to a map.

In the BlockAndPvtData, we have Block, BlockPvtData, and Missing.
These names are not very informative and get confused with another
struct named BlockPvtData. Hence, we rename
BlockAndPvtData.BlockPvtData to BlockAndPvtData.PvtData

FAB-12895 #done

Change-Id: I60af0520fc028392703a38e46c5c15ac2707a139
Signed-off-by: senthil <cendhu@gmail.com>

This change-set does the following:
- implement the nym signer/verifier
- tests

Change-Id: I60dcb8d34dc77ea84fef383d3933c2daf73827bd
Signed-off-by: Angelo De Caro <adc@zurich.ibm.com>

This introduces the concept of an "operations" endpoint for the orderer
and peer. The endpoint will support health checks, logspec management,
and, when enabled, prometheus metrics.

The endpoint uses TLS mutual auth for authentication and authorization.
Fabric roles are not used so a separate client CA is recommended.

Change-Id: Ifeb0e63faf0e3868845efad981cd1bbd16941535
Signed-off-by: Matthew Sykes <sykesmat@us.ibm.com>