Automatic merge from submit-queue

Extend logging for debugging kubemark problems

Ref #32441

Automatic merge from submit-queue

Add kubectl run ScheduledJob e2e test

**What this PR does / why we need it**:
This add another `kubectl run` e2e test, this time verifying proper creation of a ScheduledJob. 

@janetkuo ptal
@deads2k that should give you more confidence when ditching manual clients

Automatic merge from submit-queue

Extend logs for debugging upgrade test failures

Retrieve username/password from basicauth section of kubeconfig

Automatic merge from submit-queue

add break when found value

Automatic merge from submit-queue

Add the uid in a delete event to the absentOwnerCache

This is a small optimization to further reduce the traffic sent by the GC.

In #31167, GC caches the non-existent owners when it processes the dirtyQueue. As discovered in #32571, there is still small inefficiency, because there are multiple goroutines processing the dirtyQueue, many of them might send a GET to the apiserver before the cache gets populated.

This PR populates the cache when GC observes an object gets deleted, which happens before the processing of the dirtyQueue, so it avoids the simultaneous GET sent by the GC workers.

cc @lavalamp

support image type override for real in upgrade.sh script

Automatic merge from submit-queue

change the error log for empty resource usage

This PR changes the error log for empty resource usage buffer for a container to be more clear. It happens when the container name is wrong, or cAdvisor somehow does not response.

Signed-off-by: Vishnu kannan <vishnuk@google.com>

Automatic merge from submit-queue

Add Viper parametrization as E2E config option.

do-not-merge 

Fixes #18099 via viper rather than inis.  
Wont build until we remove BurntSushi/ COPYING based deps from upstream viper.
I'll dig into those issues independently and update later, before pushing the updated godeps into this PR.

Node Upgrade: Change the upgrade script to keep os distro during upgrade.

Automatic merge from submit-queue

Kubelet: add SyncPod for new runtime API

This PR adds implements of `SyncPod` for new runtime API. Note that init containers is not included, it will in another following PR.

**DO-NOT-MERGE**. Based on #31322 and #31395, only last commit is for review.

CC @yujuhong @Random-Liu and @kubernetes/sig-node @kubernetes/sig-rktnetes

Automatic merge from submit-queue

Update etcd godep to 3.0.9 to address TestWatch issues

fixes TestWatch issues #32770
addresses: https://github.com/coreos/etcd/pull/6367

Automatic merge from submit-queue

Specific error message on failed rolling update issued by older kubectl against 1.4 master

Fix #32706

`kubernetes-e2e-gke-1.4-1.3-kubectl-skew` (1.3 kubectl and 1.4 master) test suite failed with:
```
k8s.io] Kubectl client [k8s.io] Kubectl rolling-update should support rolling-update to same image [Conformance]
...
Error from server: object is being deleted: replicationcontrollers "e2e-test-nginx-rc" already exists error: exit status 1 not to have occurred
```

It's because the old RC had an orphanFinalizer, so it is not deleted from the key-value store immediately. In turn, the creation of the new RC of the same name failed. 

In this failure, the RC and pods are updated, it's just that the RC is of different name, i.e., original name + a hash generated based on podTemplate. The error is confusing to user, but not that bad. So this PR just prints a warning message to instruct users how to work around.

1.4 kubectl rolling-update uses different logic so it's working.

@lavalamp @gmarek @janetkuo @pwittrock 

cc @liggitt for the ctx changes.

Revert "[kubelet] Fix oom-score-adj policy in kubelet"

Automatic merge from submit-queue

prevent printing of stack trace when proxying 304 requests in api gateway

partially addresses #32747.

Automatic merge from submit-queue

Handle Stream() errors consistently in restclient

We should be following the same rules for Stream() as the normal body
request flow.

Also add slightly more output on a server error - in the future we may
want to clean this up but it's potentially hiding bad responses.

Related to #32009 but isn't the fix (so far)

Automatic merge from submit-queue

Make upload-to-gcs.sh include BUILD_METADATA_* env vars in started.json.

This is initially intended for storing GCI image versions.

Example output:

    $ TEST_STARTED_JSON=1 BUILD_METADATA_GCE_IMAGE=m53 \
    BUILD_METADATA_VARIANT=reliableforreal BUILD_NUMBER=123 \
    WORKSPACE="blaga" JOB_NAME="test-e2e" hack/jenkins/upload-to-gcs.sh
    {
      "version": "v1.5.0-alpha.0.806+fa943089-dirty",
      "timestamp": 1473894301,
      "metadata": {
        "gce_image": "m53",
        "variant": "reliableforreal"
      },
      "jenkins-node": ""
    }

Automatic merge from submit-queue

etcd3/watcher: logging error

To debug #32770

If error happened, the watcher might just stop/exit silently.

Automatic merge from submit-queue

Check kubeClient nil in Kubelet and bugfix

1. check kubeClient nil first before using as it maybe nil
2. configMaps and secrets map do not be used properly and should use it as cache

Automatic merge from submit-queue

Change the default volume type of GlusterFS provisioner.

At  present provisioner creates 'Distribute' Volume and  this patch change the default
volume type 'Distribute Replica:(3)' volume.

Automatic merge from submit-queue

Adding a README for federation API ref docs

The API ref docs were added in https://github.com/kubernetes/kubernetes/pull/31759

README makes it easy to link to all other API-ref docs.

This is similar to the existing docs/api-reference/README.md for kubernetes.

cc @kubernetes/sig-cluster-federation @caesarxuchao

Automatic merge from submit-queue

move informer and controller to pkg/client/cache

@kubernetes/sig-api-machinery

Automatic merge from submit-queue

Centralize install code

Trying to figure out a way to do this that makes the changes as painless to roll out as possible. This is going to be a multi-step process...

rebase

licences

[kubelet] Fix oom-score-adj policy in kubelet

Automatic merge from submit-queue

use discovery restmapper for kubectl

Updates the `kubectl` factory to use a discovery rest mapper for locating resources.  This allows generic gets.

@kargakis @sttts @fabianofranz I'll let you guys fight over it. :)

Revert "Add test for --quiet flag for kubectl run"