Automatic merge from submit-queue

Unit test for negative value of allocatable resources

Introduce unit test for checking resource quantities for kubelet's allocatable resources.

Covered values:

* negative quantity value: error expected
* invalid quantity unit: error expected
* valid quantity: error not expected

Running go test with -v, returned error are logged as well for more information:

```shell
=== RUN   TestValueOfAllocatableResources
--- PASS: TestValueOfAllocatableResources (0.00s)
    server_test.go:47: Returned err: "resource quantity for \"memory\" cannot be negative: -150G"
    server_test.go:47: Returned err: "unable to parse quantity's suffix"
PASS
ok          k8s.io/kubernetes/cmd/kubelet/app       0.020s
```

Automatic merge from submit-queue

Update swagger specs

Trying to figure out why they got out of date in parallel.. maybe we missed this in https://github.com/kubernetes/kubernetes/pull/23806?

Automatic merge from submit-queue

Don't remove kubemark binaries

If you want to experiment a bit with kubemark (e.g. relaunch the component with different flags), it's roughly impossible now. If we have binaries, this is much easier.

Automatic merge from submit-queue

moving genericapiserver command line flags to genericapiserver

cc @kubernetes/sig-api-machinery 

Automatic merge from submit-queue

Trusty: Fixes for running GKE master

This PR includes two fixes for running GKE master on our image: 
(1) The kubelet command line assembly had a missing part for cbr0. We did not catch it because the code path is not covered by OSS k8s tests;

(2) Remove the "" from the variables in the cert files. It causes a parsing issue in GKE. Again, this code path is not covered by k8s tests.

This PR also refactors the code for assembling kubelet flag. I move all logic into a single function assemble_kubelet_flags in configure-helper.sh for better readability and also simplify node.yaml and master.yaml. 

@roberthbailey @dchen1107 please review it, and mark it as cherrypick-candidate. This PR is verified by @maisem. Together with his CL for GKE, we can run GKE cluster with master on our image and nodes on ContainerVM.

cc/ @maisem @fabioy @wonderfly FYI

Automatic merge from submit-queue

Clientset release 1.3

This PR creates the release 1.3 client set. We'll keep updating this client set until we cut release 1.3. In the meantime, the release 1.2 client set will be locked.

@lavalamp 

Increase kubelet timeout from 30->45 minutes to address long build ti…

Automatic merge from submit-queue

Final vet fixes; enabling vet checks in verify scripts.

Fixes #22523, #22524

Fix density tests

Generate yaml docs for kubectl

Remove Set() from storage.Interface.

Return more useful error information when a persistent volume fails to mount

Trusty: Avoid unnecessary in-memory temp files

Automatic merge from submit-queue

Refactor E2E framework & utils to test/e2e/framework package

Refactor E2E framework & utils to test/e2e/framework package to pave the way for further refactoring and code sharing with the node e2e suite.

I've split this PR into 2 commits to try to make it more manageable: The first moves the code to the framework package (which builds on it's own), and the second fixes the test/e2e package. Unfortunately the code is so tangled up that moving it all at once this way is much easier than separating out individual pieces. Although the separation would probably be a worthwhile exercise on it's own, the goal here is to unblock the e2e_node hackathon.

One way I could reduce the number of changes is by importing the framework package as `.`. I didn't do this since I think it's not great practice - but I'm open to making this change if you (reviewers) think otherwise.

LMK if there's any way I can help to make this more reviewable.

@kubernetes/sig-node @kubernetes/sig-testing @vishh @pwittrock @jayunit100 

Automatic merge from submit-queue

Rewrite docker-checker.sh to make it less kill-happy.

e2e: fix error checking in kubelet stats

Automatic merge from submit-queue

Fixed mounting with containerized kubelet

`NsenterMounter.IsLikelyNotMountPoint()` should return `ErrNotExist` when the
checked directory does not exists - the regular mounted does this and
some volume plugins depend on this behavior.

See for example: https://github.com/kubernetes/kubernetes/blob/master/pkg/volume/aws_ebs/aws_util.go#L72

Automatic merge from submit-queue

Adding nodeports services to quota

To fix #21677
@derekwaynecarr 

Automatic merge from submit-queue

Implement a streaming serializer for watch

Changeover watch to use streaming serialization. Properly version the
watch objects. Implement simple framing for JSON and Protobuf (but not
YAML).

@wojtek-t @lavalamp

Automatic merge from submit-queue

Increase 5 node kubemark to a 60m timeout, schedule every 5m

Closes https://github.com/kubernetes/kubernetes/issues/24183 and should reduce mergebot flakes

http://kubekins.dls.corp.google.com/view/Submit%20Queue/job/kubernetes-kubemark-5-gce/1354/consoleFull is an example where everything seemed to be running find but ran out of time after 30m, which is only slightly slower than its average passing runtime of 20m. I'm increasing to 3x average runtime.

Automatic merge from submit-queue

Add godoc to kubelet/volumes.go

Noticed that `mountExternalVolumes`, of all things, was missing Godoc while working w/ @screeley44.  Decided to add some tonight since I have been making noise about grokkability of the kubelet lately.

@kubernetes/sig-storage  

Automatic merge from submit-queue

IPerf container to support network perfomance testing

Simple iperf container.

Issue:
We want to run iperf from the e2e tests for a network baseline, but there are no gcr images for this.

Solution:
Curate our own iperf container from source in kubernetes and copy it as a top level microservice.  So long as these are injected into GCR, we can then run this container from the e2e tests.

 cc @sig-testing this can be used along side #22869 

Automatic merge from submit-queue

Add suite pages to test-history

This changes http://storage.googleapis.com/kubernetes-test-history/static/index.html to look like:

![image](https://cloud.githubusercontent.com/assets/211868/14445317/f263e1da-0000-11e6-9bd9-01150d9ae4ba.png)

And adds sub-pages to show test results for specific suites:

![image](https://cloud.githubusercontent.com/assets/211868/14445339/1bb8555c-0001-11e6-9e5c-41d671af39a1.png)

Revert "Run most GCE, GKE, and Kubemark e2e jobs inside Docker"

This makes it easier to determine which tests cause particular suites to
fail.

All static HTML pages are now generated by one invocation of gen_html.py.

- make index include good/flake/fail numbers for each link
- consistently use % for string interpolation

e2e-runner: don't clean old binaries before upgrade